-- Logs begin at Fri 2022-06-17 12:04:40 UTC, end at Fri 2022-06-17 13:54:30 UTC. -- Jun 17 12:42:11.090196 dv-cinder-837543-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 17 12:42:11.097886 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 12:42:11 2022] *** Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: nodename: dv-cinder-837543-5-iscsi Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: machine: x86_64 Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: clock source: unix Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: pcre jit disabled Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: detected number of CPU cores: 4 Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: current working directory: / Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: detected binary path: /usr/bin/uwsgi-core Jun 17 12:42:11.100207 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: your processes number limit is 47680 Jun 17 12:42:11.100812 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: your memory page size is 4096 bytes Jun 17 12:42:11.100812 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: detected max file descriptor number: 2048 Jun 17 12:42:11.100812 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: lock engine: pthread robust mutexes Jun 17 12:42:11.101478 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: thunder lock: enabled Jun 17 12:42:11.102126 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 17 12:42:11.102126 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 12:42:11.147187 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: Python main interpreter initialized at 0x5581b5b799c0 Jun 17 12:42:11.147187 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: python threads support enabled Jun 17 12:42:11.147187 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: your server socket listen backlog is limited to 100 connections Jun 17 12:42:11.147187 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: your mercy for graceful operations on workers is 90 seconds Jun 17 12:42:11.147696 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 12:42:11.147774 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: *** Operational MODE: preforking *** Jun 17 12:42:11.148249 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: *** uWSGI is running in multiple interpreter mode *** Jun 17 12:42:11.148249 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: spawned uWSGI master process (pid: 80146) Jun 17 12:42:11.148482 dv-cinder-837543-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 17 12:42:11.150362 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: spawned uWSGI worker 1 (pid: 80157, cores: 1) Jun 17 12:42:11.150362 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: spawned uWSGI worker 2 (pid: 80158, cores: 1) Jun 17 12:42:11.150362 dv-cinder-837543-5-iscsi devstack@keystone.service[80146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 12:42:16.726542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:42:16.726542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: from cryptography.utils import int_from_bytes Jun 17 12:42:16.727762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:42:16.727762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: from cryptography.utils import int_from_bytes Jun 17 12:42:16.728803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:42:16.728803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: from cryptography.utils import int_from_bytes Jun 17 12:42:16.729572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 12:42:16.729572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: from cryptography.utils import int_from_bytes Jun 17 12:42:16.783450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:42:16.783742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 12:42:16.783742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:42:16.784032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 12:42:16.784180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] command line args: [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:42:16.784311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] command line args: [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 12:42:16.784446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:42:16.784446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ================================================================================ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:42:16.784686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 12:42:16.784815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] admin_token = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.784957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ================================================================================ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 12:42:16.785094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] config_dir = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.785094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.785329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] admin_token = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.785453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] config_source = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.785453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] debug = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.785689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.786019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] config_dir = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.786019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.786381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.786381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.786726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] config_source = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.786885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.787047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] debug = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.787206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.787206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.787611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.787810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_config_append = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.787810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.788138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.788309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_dir = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.788309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.788617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.788795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.788954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.789121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.789121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.789447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.789616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.789616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.789936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.790156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.790336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_config_append = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.790524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.790524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.790821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.791004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.791143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_dir = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.791336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.791336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.791626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.791765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.791889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.791889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.791889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.792306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.792306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.792601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.792960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.793326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.793663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.793994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.794355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.794690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.886666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.886947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.887241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.887785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.887979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] publish_errors = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.888229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.888471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.888656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.888916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.889161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.889404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] standard_threads = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.889646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.889895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.890077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.890279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_journal = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.890460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_json = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.890587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.890766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_stderr = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.890905 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_syslog = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.891035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.891160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.891298 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.891461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.891701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.891823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.892002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.892256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.892406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.892546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.892671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] publish_errors = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.892795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.892971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.893123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.893256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.893430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.893564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.893688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.893810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.893954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.894194 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.894327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.894451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.894614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.894766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.894906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.895058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] standard_threads = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.895190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.895381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.895512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.895639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.895880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.896022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.896156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.896280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.896418 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.896542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_journal = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.896687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.896913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_json = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.897107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.897470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_stderr = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.897616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.897743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_syslog = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.897881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.897881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.898129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 12:42:16.898284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.898284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.898528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.898766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.898766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.898994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.899118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.899252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.899384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.899520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.899644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.899773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.899901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.900094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.900224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.900417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.900549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.900728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.900855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.900977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.901097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.901239 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.901432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.901573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.901696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.901887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.902027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.902216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.902346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.902471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.902593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.902790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.902925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.903063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.903216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.903348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.903483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.903659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.903806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.903939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.904090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.904222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.904388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.904526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.904662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.904847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.904977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.905102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.905312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.905444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.905689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.905817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.905940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.906064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.906286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.906414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.906552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.906722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.906863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.907049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.907175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.907298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.907437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.907634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.907768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.907891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.908090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.908224 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.908359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.908541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.908672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.908813 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.908981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.909101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.909290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.909405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.909516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.909748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.909869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.910037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.910263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.910377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.910494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.910601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.910707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.910978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.911195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.911397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.911397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.911783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.911982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.912178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.912370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.912370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.913028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.913153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.913153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.913356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.913476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.913604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.913714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.913714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.913910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.914020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.914157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.914349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.914483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.914667 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.914845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.914974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.914974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.915276 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.915469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.915647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.915776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.915776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.916065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.916208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.916208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.external = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.916496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.916623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.916748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.916873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.917044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.917181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.917412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.password = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.917545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.917671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.token = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.917855 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.918003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.918218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.918346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.918546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.918675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.918799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.918935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.919072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.919199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.919324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.919500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.919631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.919771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.919926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.920069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.920229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.920366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.920494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.920698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.920831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.920957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.921178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.921360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.921572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.921871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.922117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.922117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.922512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.922713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.922906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.923096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.923096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.923492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.923681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.923871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.924061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.924061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.924454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.924643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.924643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.924998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.925187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.925187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.925557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.925744 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.925744 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.926116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.926335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.926335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.926715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.926919 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.927109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.927298 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.927298 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.927661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.927861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.927861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.928278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.928480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.928480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.928857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.929052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.929260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.929477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.929477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.929856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.930062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.930062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.930472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.930678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.930678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.930678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.931204 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.931392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.931392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.931761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.931965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.931965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.932335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.932524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.932713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.932916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.932916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.933270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.933459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.933459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.933820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.934024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.934024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.934363 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.934624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.934624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.934992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.935196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.935386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.935575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.935575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.935946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.936137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.936137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.936552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.936741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.936957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.937099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.937099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.937402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.937531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.937531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.937779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.937907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.937907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.938198 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.938328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.938328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.938558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.938686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.938686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.938927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.939057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.939057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.939294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.939421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.939421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.939664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.939800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.939927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.940053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.940180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.940311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.940311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.940564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.940690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.940690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.940942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.941070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.941070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.941422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.941550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.941687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.941813 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.941813 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.942068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.942294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.942294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.942527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.942656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.942656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.942909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.943037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.943037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.943267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.943394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.943536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.943669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.943669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.943998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.944122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.944122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.944373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.944503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.944503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.944735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.944864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.944989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.external = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.945128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.945128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.945359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.945484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.945484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.945484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.945484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.945484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.945484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.946170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.946316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.946316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.946564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.946692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.946819 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.password = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.946944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.946944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.947183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.token = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.947323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.947323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.947555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.947679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.947679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.947910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.948050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.948176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.948328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.948328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.948560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.948685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.948685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.948945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.949082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.949249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.949362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.949362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.949710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.949837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.949837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.950066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.950208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.950208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] role.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.950457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.950585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] role.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.950585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.950816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.950942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.950942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.951192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.951319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.951446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.951573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.951573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.951804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.951945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.952073 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.952197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.952323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.952524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.952655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.952795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.953020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.953156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.953408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.953543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.953689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.953851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.954254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.954391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.954541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.954670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.954809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.954937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.955064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.955217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.955351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.955507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.955649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.955777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.956025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.956159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.956285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.956464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.956610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.956739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.956866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.956993 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.957148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.957301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.957443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.957702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.957840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.957969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.958121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.958252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.958492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.958625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.958751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.958935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.959072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.959199 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.959442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.959579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.959864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.960090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.960227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.960355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.960544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.960681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.960809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.960967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.961101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.961256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.961406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.961535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.961719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.961850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.961979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.962251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.962409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.962539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.962696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.962829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.963034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.963168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.963413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.963564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.963704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.963888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.964026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.964163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.964287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.964428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.964555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.964716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.964852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.965062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.965196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.965341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.965530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.965661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.965788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.965962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.966129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.966386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.966518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.966645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.966771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.966895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.967021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.967161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.967298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.967427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.967605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.967739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.967868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:42:16.968085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.968441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.968785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.969150 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.969481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.969813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.970259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.970548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.970871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.971200 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.971537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.971871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.972248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.972572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.972912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.973252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.973589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.973932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.974307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.974632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.975166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.975519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.975854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.976234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.976628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.976914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.977243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.977592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.977934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.978298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.978633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.978976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.979322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.979651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.979978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.980308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.980642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.980979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.981338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.981658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.981996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.982382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.982732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.983058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.983378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.983708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.984032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.984372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.984692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.985030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.985367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.985703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.986427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.986771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.987090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.987426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.987749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.988073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.988396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.988725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.989054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.989389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.989713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.990055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.990404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.990829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.991195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.991521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.991846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.992183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.992519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.992847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.993170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.993498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.993839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.994212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.994539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.994889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.995230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.995554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.995889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.996212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.996535 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.996866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] role.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.997201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] role.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.997519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.997855 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.998224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.998563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.998913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.999253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.999589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:16.999928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.000267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.000613 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.000822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.001024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.001163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.001293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.001460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.001808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.002183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.002709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.003032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.003366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.003706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.004051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.004396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.004718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.005060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.005399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.005721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.006045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.006503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.006823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.007160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.007503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.007835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.008168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.008494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.008809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.009131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.009457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.009850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.010206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.010555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.010738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.010960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.011289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.011618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.011957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.012291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.012614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.012940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.013355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.013675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.014021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.014362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.014694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.015079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.015426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.015767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.016133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.016470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.016800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.017126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.017448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.017771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.018171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.018479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.018807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.019144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.019468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.019809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.020132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.020469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.020786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.021141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.021465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 12:42:17.021795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 12:42:17.041096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.041510 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.048511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.048737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.049000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.058136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.078054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.078413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.098754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.119981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.153163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.153434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.157094 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.157412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.225599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.226071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.226071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.226407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.226534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.226723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.226723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.226983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.227140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.227392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.227675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.227958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.252521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.252772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.252901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.253036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.253167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.253274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.253397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.253504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.253608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.253703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.253799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.253904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.254025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.254190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.265864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.266950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.279583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.279850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.280123 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.280261 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.280424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.280595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.280761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.280888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.281051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.281176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.281448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.281734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.282021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.282332 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 12:42:17.299032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.299255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 12:42:17.299563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.299763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 12:42:17.299880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.300012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 12:42:17.300139 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.300286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.300513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.300682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.300802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.300928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 12:42:17.301247 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.301653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.302074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.302496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.312360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.312657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.312927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.313207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.322151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.322905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.323362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.323802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.324251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.325472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.325747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.326026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.326331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.326608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.326861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.327123 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.327389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.327651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.327916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.328174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.340606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.346743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.347194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.347670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.348146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.348619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.349057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.349639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.350106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.350583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.351079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.351525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.356032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.357692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.358000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.363681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.364098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.364341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.371798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.372057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.376800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.377085 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.377364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.377642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.377912 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.378209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.378475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.378737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.397846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.398139 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.402796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.403828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.406431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.406834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.406988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.407295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.411836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.416053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.417504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.417987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.418793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.419720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.420015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.420293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.420563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.420876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.421123 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.433049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.433539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.442070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.442305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.442405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.442585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.442711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.442923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.443047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.443454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.443993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.444467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.444933 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.445344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.451201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.453015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.453300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.456504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.456784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.457059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.457347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.457622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.471573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.471891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.472160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.472441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.472820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.473096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.473433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.481885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.482356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.491786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.492031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.495194 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.498501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.498825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.499299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.500235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.501920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.502219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.502522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.509109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.509880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.511586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.514821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.515101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.515499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.515774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.515873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.522880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.523396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.523861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.524338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.524796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.525287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.525447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.525725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.526000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.533928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.534238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.534510 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.534780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.535057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.535447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.535727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.536000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.536265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.536536 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.536800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.537075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.537455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.537788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.566445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.566958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.567406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.567832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.582854 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581b5b799c0 pid: 80157 (default app) Jun 17 12:42:17.584764 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.586831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e456-6f3d-4696-a4cb-0f7b38be1ff5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:17.587106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e456-6f3d-4696-a4cb-0f7b38be1ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:17.587421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e456-6f3d-4696-a4cb-0f7b38be1ff5 None None] PATH_INFO: `/v3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:17.588688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.589181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.591931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Fri Jun 17 12:42:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:17.595776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.596281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.596787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.597322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.597768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.625598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.626130 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.626611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.627102 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.627596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.628328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.628737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.665849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.673262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.680505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.684352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.687901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.688408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.690614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.704525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.708008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.715918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.715918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.715918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.716439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.736233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.737066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.737299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.753003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 12:42:17.753424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.753891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.754382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.754924 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.755567 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.756055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.756690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.757539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.757685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.758144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.758757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.759486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.759627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 12:42:17.835479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581b5b799c0 pid: 80158 (default app) Jun 17 12:42:26.133658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ebfeb-0da4-435b-b795-8a50f579e745 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:26.134310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ebfeb-0da4-435b-b795-8a50f579e745 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:26.134554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ebfeb-0da4-435b-b795-8a50f579e745 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:26.137014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:26.148509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:26.149072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:26.149172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:26.229598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: INFO dbcounter [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] Registered counter for database keystone Jun 17 12:42:26.258301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG oslo_db.sqlalchemy.engines [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:42:26.268401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writer thread running {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:42:26.527346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG passlib.handlers.bcrypt [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80158) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 12:42:26.527790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG passlib.handlers.bcrypt [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80158) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 12:42:26.585172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:26.587035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:26.732963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 589 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 17 12:42:26.899476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ebfeb-0da4-435b-b795-8a50f579e745 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:26.983920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: INFO dbcounter [None req-560ebfeb-0da4-435b-b795-8a50f579e745 None None] Registered counter for database keystone Jun 17 12:42:27.005672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG oslo_db.sqlalchemy.engines [None req-560ebfeb-0da4-435b-b795-8a50f579e745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 12:42:27.013028 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writer thread running {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 12:42:27.143072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ebfeb-0da4-435b-b795-8a50f579e745 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:27.148736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3c644-ac51-45d4-9ada-0b7db16ce335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:27.149448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c644-ac51-45d4-9ada-0b7db16ce335 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:27.149790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c644-ac51-45d4-9ada-0b7db16ce335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:27.150019 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3c644-ac51-45d4-9ada-0b7db16ce335 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:27.159886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c644-ac51-45d4-9ada-0b7db16ce335 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:27.216232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7bc3c644-ac51-45d4-9ada-0b7db16ce335 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 12:42:27.216608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3c644-ac51-45d4-9ada-0b7db16ce335 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:27.228408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Jun 17 12:42:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 12:42:27.236436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:27.261032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b78917-1cd8-4b38-a6c0-72fc160a9ad3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:27.266460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d2062-078e-45c1-be99-dfcb49eb230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:27.268068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2062-078e-45c1-be99-dfcb49eb230d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:27.268562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2062-078e-45c1-be99-dfcb49eb230d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:27.268939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d2062-078e-45c1-be99-dfcb49eb230d admin admin] PATH_INFO: `/v3/projects/91e888714806438f834a0309a74fcb9e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:27.271321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d2062-078e-45c1-be99-dfcb49eb230d admin admin] RBAC: Authorizing `identity:get_project(project_id=91e888714806438f834a0309a74fcb9e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:27.338659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f2d2062-078e-45c1-be99-dfcb49eb230d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 12:42:27.338990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d2062-078e-45c1-be99-dfcb49eb230d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:27.344189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Jun 17 12:42:27 2022] GET /identity/v3/projects/91e888714806438f834a0309a74fcb9e => generated 344 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:29.581479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae67db-1040-4c6a-a383-95ba415ef866 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:29.582048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae67db-1040-4c6a-a383-95ba415ef866 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:29.582048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae67db-1040-4c6a-a383-95ba415ef866 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:29.586549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:29.593028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec89cd-2954-4c5c-a056-4e1d529a571b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:29.593649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec89cd-2954-4c5c-a056-4e1d529a571b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:29.593649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec89cd-2954-4c5c-a056-4e1d529a571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:29.616296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-35ec89cd-2954-4c5c-a056-4e1d529a571b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:29.617890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-35ec89cd-2954-4c5c-a056-4e1d529a571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:29.627419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 17 12:42:29.652273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae67db-1040-4c6a-a383-95ba415ef866 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:29.670883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae67db-1040-4c6a-a383-95ba415ef866 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:29.678043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29502a01-ef63-480d-82a9-becb16d9bd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:29.679074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29502a01-ef63-480d-82a9-becb16d9bd60 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:29.679433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29502a01-ef63-480d-82a9-becb16d9bd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:29.679794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29502a01-ef63-480d-82a9-becb16d9bd60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:29.695644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29502a01-ef63-480d-82a9-becb16d9bd60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:29.698817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29502a01-ef63-480d-82a9-becb16d9bd60 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:29.711478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Jun 17 12:42:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 12:42:29.718765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec89cd-2954-4c5c-a056-4e1d529a571b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:29.728923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec89cd-2954-4c5c-a056-4e1d529a571b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:29.736518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0203-c094-48a0-b377-539690ffda6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:29.737453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0203-c094-48a0-b377-539690ffda6a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:29.737743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0203-c094-48a0-b377-539690ffda6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:29.738028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0203-c094-48a0-b377-539690ffda6a admin admin] PATH_INFO: `/v3/users/037e9f95a2ad44f08247184b10274c13` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:29.739586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0203-c094-48a0-b377-539690ffda6a admin admin] RBAC: Authorizing `identity:get_user(user_id=037e9f95a2ad44f08247184b10274c13)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:29.742193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0203-c094-48a0-b377-539690ffda6a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:29.743928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Jun 17 12:42:29 2022] GET /identity/v3/users/037e9f95a2ad44f08247184b10274c13 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:32.038946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b881ed-0d3d-4002-9ad8-f06d41c00856 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.039529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b881ed-0d3d-4002-9ad8-f06d41c00856 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.039529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b881ed-0d3d-4002-9ad8-f06d41c00856 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.040966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:42:32.047311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e26b7d-2e8f-4c4f-b405-e0426d25d64d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.047861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e26b7d-2e8f-4c4f-b405-e0426d25d64d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.047968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e26b7d-2e8f-4c4f-b405-e0426d25d64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.071603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-59e26b7d-2e8f-4c4f-b405-e0426d25d64d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:32.073119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-59e26b7d-2e8f-4c4f-b405-e0426d25d64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:32.127293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca11e-2b9e-4531-b29d-b8206d87d105 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.127569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca11e-2b9e-4531-b29d-b8206d87d105 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.127863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca11e-2b9e-4531-b29d-b8206d87d105 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.129320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 7/11] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:32.137278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20620d-776d-4837-a332-37a2794cc9aa None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.138484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20620d-776d-4837-a332-37a2794cc9aa None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.139009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20620d-776d-4837-a332-37a2794cc9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.183345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 5/12] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:32.190520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG passlib.handlers.bcrypt [None req-5d20620d-776d-4837-a332-37a2794cc9aa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80157) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 12:42:32.190951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG passlib.handlers.bcrypt [None req-5d20620d-776d-4837-a332-37a2794cc9aa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80157) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 12:42:32.207512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e26b7d-2e8f-4c4f-b405-e0426d25d64d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:32.239422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5d20620d-776d-4837-a332-37a2794cc9aa None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:32.240572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:32.241944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5d20620d-776d-4837-a332-37a2794cc9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:32.330007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e26b7d-2e8f-4c4f-b405-e0426d25d64d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:32.358253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:32.368122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2b370-43a1-4946-af9d-26df1a917117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:32.368998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b370-43a1-4946-af9d-26df1a917117 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.369320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b370-43a1-4946-af9d-26df1a917117 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.369664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2b370-43a1-4946-af9d-26df1a917117 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.382725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20620d-776d-4837-a332-37a2794cc9aa None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:32.384694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2b370-43a1-4946-af9d-26df1a917117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dad2b370-43a1-4946-af9d-26df1a917117 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:32.397467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:32.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:32.402455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 6/14] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:42:32.405242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2b370-43a1-4946-af9d-26df1a917117 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:32.506242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:32.523558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20620d-776d-4837-a332-37a2794cc9aa None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:32.526735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:32.529449 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2b370-43a1-4946-af9d-26df1a917117 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:32.573279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f4a20-d7e7-40e9-a951-da45f5cce687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:32.573651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424aa9c3-8a3d-4316-9f36-0ee0475d90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:32.573934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f4a20-d7e7-40e9-a951-da45f5cce687 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.574442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f4a20-d7e7-40e9-a951-da45f5cce687 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.574739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f4a20-d7e7-40e9-a951-da45f5cce687 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.574825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424aa9c3-8a3d-4316-9f36-0ee0475d90fa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.575042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424aa9c3-8a3d-4316-9f36-0ee0475d90fa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.575318 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424aa9c3-8a3d-4316-9f36-0ee0475d90fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.575543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f4a20-d7e7-40e9-a951-da45f5cce687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:32.575905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f4a20-d7e7-40e9-a951-da45f5cce687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:32.577444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f4a20-d7e7-40e9-a951-da45f5cce687 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:32.591471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 7/15] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:32.597424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f4a20-d7e7-40e9-a951-da45f5cce687 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:32.673501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424aa9c3-8a3d-4316-9f36-0ee0475d90fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:32.675241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424aa9c3-8a3d-4316-9f36-0ee0475d90fa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:32.729356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f4a20-d7e7-40e9-a951-da45f5cce687 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:32.769857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632380b-0d18-45ad-949a-b29188ee53a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:32.770849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632380b-0d18-45ad-949a-b29188ee53a7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.771143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632380b-0d18-45ad-949a-b29188ee53a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.771502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632380b-0d18-45ad-949a-b29188ee53a7 None admin] PATH_INFO: `/v3/users/037e9f95a2ad44f08247184b10274c13` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.772964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632380b-0d18-45ad-949a-b29188ee53a7 None admin] RBAC: Authorizing `identity:get_user(user_id=037e9f95a2ad44f08247184b10274c13)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:32.774707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632380b-0d18-45ad-949a-b29188ee53a7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:32.776602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 8/16] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:32 2022] GET /identity/v3/users/037e9f95a2ad44f08247184b10274c13 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:32.782893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632380b-0d18-45ad-949a-b29188ee53a7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:32.799757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:32.805598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 9/17] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 12:42:32.811737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424aa9c3-8a3d-4316-9f36-0ee0475d90fa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:32.815308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:32.901279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632380b-0d18-45ad-949a-b29188ee53a7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:32.927730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424aa9c3-8a3d-4316-9f36-0ee0475d90fa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:32.942332 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7aef5-f217-43df-9138-6c62a199a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:32.943172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7aef5-f217-43df-9138-6c62a199a8bb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.943590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7aef5-f217-43df-9138-6c62a199a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.943935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7aef5-f217-43df-9138-6c62a199a8bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.945560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7aef5-f217-43df-9138-6c62a199a8bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:32.947132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7aef5-f217-43df-9138-6c62a199a8bb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:32.948811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:32.955526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7aef5-f217-43df-9138-6c62a199a8bb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:32.973689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0bdec-ec49-4d53-8732-36702e65c86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:32.974556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0bdec-ec49-4d53-8732-36702e65c86c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:32.974955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0bdec-ec49-4d53-8732-36702e65c86c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:32.975231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0bdec-ec49-4d53-8732-36702e65c86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:32.997760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0bdec-ec49-4d53-8732-36702e65c86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:32.999431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0bdec-ec49-4d53-8732-36702e65c86c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3ea0bdec-ec49-4d53-8732-36702e65c86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:42:33.022829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:33.023997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:33.025985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:42:33.025985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:42:33.025985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:42:33.025985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:42:33.025985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:42:33.031539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0bdec-ec49-4d53-8732-36702e65c86c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:33.051071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:33.079018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7aef5-f217-43df-9138-6c62a199a8bb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:33.101050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:33.127350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8133-23a5-4f99-bd71-e65b8f0a4e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:33.128486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8133-23a5-4f99-bd71-e65b8f0a4e3a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:33.128800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8133-23a5-4f99-bd71-e65b8f0a4e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:33.129195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8133-23a5-4f99-bd71-e65b8f0a4e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:33.130325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8133-23a5-4f99-bd71-e65b8f0a4e3a None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.domain.id=default, user.id=037e9f95a2ad44f08247184b10274c13) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:33.130902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8133-23a5-4f99-bd71-e65b8f0a4e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:33.133481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8133-23a5-4f99-bd71-e65b8f0a4e3a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:33.143897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Jun 17 12:42:32 2022] GET /identity/v3/role_assignments?user.id=037e9f95a2ad44f08247184b10274c13&scope.domain.id=default&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 233 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:33.154198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0bdec-ec49-4d53-8732-36702e65c86c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:33.196905 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36366e-b820-4fd3-b2f0-cfaf4c616c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:33.197643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36366e-b820-4fd3-b2f0-cfaf4c616c12 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:33.197926 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36366e-b820-4fd3-b2f0-cfaf4c616c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:33.198230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36366e-b820-4fd3-b2f0-cfaf4c616c12 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:33.198977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36366e-b820-4fd3-b2f0-cfaf4c616c12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:33.199287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36366e-b820-4fd3-b2f0-cfaf4c616c12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:33.200755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36366e-b820-4fd3-b2f0-cfaf4c616c12 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:33.222670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:36.327842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c2fb-08dd-46dc-a00d-2302d233aa75 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:36.328424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c2fb-08dd-46dc-a00d-2302d233aa75 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:36.328496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c2fb-08dd-46dc-a00d-2302d233aa75 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:36.330044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:36.337678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbbed-7099-44d4-896f-3d8c1911905a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:36.338258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbbed-7099-44d4-896f-3d8c1911905a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:36.338674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbbed-7099-44d4-896f-3d8c1911905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:36.367088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b71dbbed-7099-44d4-896f-3d8c1911905a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:36.368423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b71dbbed-7099-44d4-896f-3d8c1911905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:36.509593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:36.553566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98c2fb-08dd-46dc-a00d-2302d233aa75 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:36.570855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd8e27-3bbc-4c5b-94e3-8ce1669948bc None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:36.571212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd8e27-3bbc-4c5b-94e3-8ce1669948bc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:36.571503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd8e27-3bbc-4c5b-94e3-8ce1669948bc None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:36.573086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:36.591297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9eb3-c173-42cb-89a8-41070ed411f5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:36.591653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9eb3-c173-42cb-89a8-41070ed411f5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:36.591961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9eb3-c173-42cb-89a8-41070ed411f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:36.627928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-28fd9eb3-c173-42cb-89a8-41070ed411f5 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:36.629205 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-28fd9eb3-c173-42cb-89a8-41070ed411f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:36.786469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:36.846426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 14/25] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:42:36.848545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29622-21fd-4041-be76-d904ce38ffee None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:36.849141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29622-21fd-4041-be76-d904ce38ffee None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:36.849799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29622-21fd-4041-be76-d904ce38ffee None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:36.852132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98c2fb-08dd-46dc-a00d-2302d233aa75 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:36.858562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 15/26] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:36.868561 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43315161-530a-495b-a6af-1d63d19a43c6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:36.869159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43315161-530a-495b-a6af-1d63d19a43c6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:36.869949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43315161-530a-495b-a6af-1d63d19a43c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:36.904107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-43315161-530a-495b-a6af-1d63d19a43c6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:36.905988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-43315161-530a-495b-a6af-1d63d19a43c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:36.918074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d5210-650a-45f7-bbd7-10929b1ddded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:36.918909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5210-650a-45f7-bbd7-10929b1ddded None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:36.919257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5210-650a-45f7-bbd7-10929b1ddded None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:36.919505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5210-650a-45f7-bbd7-10929b1ddded None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:36.940509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d5210-650a-45f7-bbd7-10929b1ddded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7f2d5210-650a-45f7-bbd7-10929b1ddded None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:36.949489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:36.950461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:36.951213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 12/27] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:36.951851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d5210-650a-45f7-bbd7-10929b1ddded None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:36.960478 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:37.011340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 16/28] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 17 12:42:37.012646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43315161-530a-495b-a6af-1d63d19a43c6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:37.179688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d5210-650a-45f7-bbd7-10929b1ddded None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:37.209526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43315161-530a-495b-a6af-1d63d19a43c6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:37.220085 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:37.228621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b28369-d612-4be8-93e9-3f345f7e83d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:37.230290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b28369-d612-4be8-93e9-3f345f7e83d5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:37.230814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b28369-d612-4be8-93e9-3f345f7e83d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:37.231565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b28369-d612-4be8-93e9-3f345f7e83d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:37.249279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b28369-d612-4be8-93e9-3f345f7e83d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:37.251720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b28369-d612-4be8-93e9-3f345f7e83d5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:37.251988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adb7e4-104e-45ea-b904-052286ca0d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:37.252686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adb7e4-104e-45ea-b904-052286ca0d74 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:37.253007 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adb7e4-104e-45ea-b904-052286ca0d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:37.253244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adb7e4-104e-45ea-b904-052286ca0d74 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:37.254014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adb7e4-104e-45ea-b904-052286ca0d74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:37.254368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adb7e4-104e-45ea-b904-052286ca0d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:37.256074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adb7e4-104e-45ea-b904-052286ca0d74 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:37.269968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 17/29] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:37.270945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adb7e4-104e-45ea-b904-052286ca0d74 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-99b28369-d612-4be8-93e9-3f345f7e83d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:42:37.283546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:37.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:37.285436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:42:37.285436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:42:37.285436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:42:37.285436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:37.287833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 13/30] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:37.289655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057ad57-3031-4957-b475-9de8c0d5e065 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:37.289947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057ad57-3031-4957-b475-9de8c0d5e065 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:37.290272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057ad57-3031-4957-b475-9de8c0d5e065 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:37.291776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 14/31] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:37.296616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057ad57-3031-4957-b475-9de8c0d5e065 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:37.391263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:37.447071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adb7e4-104e-45ea-b904-052286ca0d74 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:37.455700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057ad57-3031-4957-b475-9de8c0d5e065 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:37.501860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921b89-1223-4eaf-8fd7-17ed2a4ce551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:37.503577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921b89-1223-4eaf-8fd7-17ed2a4ce551 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:37.504157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921b89-1223-4eaf-8fd7-17ed2a4ce551 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:37.504580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921b89-1223-4eaf-8fd7-17ed2a4ce551 None admin] PATH_INFO: `/v3/users/037e9f95a2ad44f08247184b10274c13` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:37.506695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47921b89-1223-4eaf-8fd7-17ed2a4ce551 None admin] RBAC: Authorizing `identity:get_user(user_id=037e9f95a2ad44f08247184b10274c13)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:37.508815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47921b89-1223-4eaf-8fd7-17ed2a4ce551 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:37.510610 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be01aa2-e0b4-4572-8163-438e472b9a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:37.511115 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 15/32] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:37 2022] GET /identity/v3/users/037e9f95a2ad44f08247184b10274c13 => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:37.512048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921b89-1223-4eaf-8fd7-17ed2a4ce551 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:37.512724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be01aa2-e0b4-4572-8163-438e472b9a6d None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:37.513362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be01aa2-e0b4-4572-8163-438e472b9a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:37.513986 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be01aa2-e0b4-4572-8163-438e472b9a6d None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:37.515615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be01aa2-e0b4-4572-8163-438e472b9a6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:37.518763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be01aa2-e0b4-4572-8163-438e472b9a6d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:37.648536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921b89-1223-4eaf-8fd7-17ed2a4ce551 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:37.656957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 18/33] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 12:42:37 2022] POST /identity/v3/roles => generated 219 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:42:37.659023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa04c-5336-4f9e-ad0b-bca2ecc2fb54 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:37.659387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa04c-5336-4f9e-ad0b-bca2ecc2fb54 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:37.659770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa04c-5336-4f9e-ad0b-bca2ecc2fb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:37.687487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:37.689063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-92eaa04c-5336-4f9e-ad0b-bca2ecc2fb54 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:37.691746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-92eaa04c-5336-4f9e-ad0b-bca2ecc2fb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:37.704619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60449a30-4054-44e9-948f-c6b47ecfe793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:37.706370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60449a30-4054-44e9-948f-c6b47ecfe793 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:37.706802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60449a30-4054-44e9-948f-c6b47ecfe793 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:37.707185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60449a30-4054-44e9-948f-c6b47ecfe793 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:37.708129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60449a30-4054-44e9-948f-c6b47ecfe793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:37.708563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60449a30-4054-44e9-948f-c6b47ecfe793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:37.711245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60449a30-4054-44e9-948f-c6b47ecfe793 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:37.741207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:37.744259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 16/34] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:37.745767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60449a30-4054-44e9-948f-c6b47ecfe793 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:37.823037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 19/35] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:37.824336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaa04c-5336-4f9e-ad0b-bca2ecc2fb54 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:37.924008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60449a30-4054-44e9-948f-c6b47ecfe793 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:37.982311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3581-a1de-49ad-89c2-65177eb76535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:37.984380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3581-a1de-49ad-89c2-65177eb76535 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:37.985317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3581-a1de-49ad-89c2-65177eb76535 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:37.985750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3581-a1de-49ad-89c2-65177eb76535 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:37.988046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c3581-a1de-49ad-89c2-65177eb76535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:37.989760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c3581-a1de-49ad-89c2-65177eb76535 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:37.992929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 17/36] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:37.994589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baf6f2-33dd-4b96-b062-1525091331c7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:37.994918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baf6f2-33dd-4b96-b062-1525091331c7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:37.995335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baf6f2-33dd-4b96-b062-1525091331c7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:37.996929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 18/37] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:37.997589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baf6f2-33dd-4b96-b062-1525091331c7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:38.032824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaa04c-5336-4f9e-ad0b-bca2ecc2fb54 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:38.101000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:38.175633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baf6f2-33dd-4b96-b062-1525091331c7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:38.211888 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9462c-4d34-4fa9-a0d2-40ab68fe85ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:38.212608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9462c-4d34-4fa9-a0d2-40ab68fe85ac None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:38.212909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9462c-4d34-4fa9-a0d2-40ab68fe85ac None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:38.213183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9462c-4d34-4fa9-a0d2-40ab68fe85ac None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:38.214270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9462c-4d34-4fa9-a0d2-40ab68fe85ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:38.215991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9462c-4d34-4fa9-a0d2-40ab68fe85ac None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:38.226693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291299d-c706-4742-927b-20fc600f7a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:38.227571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291299d-c706-4742-927b-20fc600f7a8e None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:38.227894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291299d-c706-4742-927b-20fc600f7a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:38.228287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291299d-c706-4742-927b-20fc600f7a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:38.229049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291299d-c706-4742-927b-20fc600f7a8e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:38.230721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291299d-c706-4742-927b-20fc600f7a8e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:38.249997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 20/38] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:42:37 2022] POST /identity/v3/projects => generated 301 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:42:38.250756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9462c-4d34-4fa9-a0d2-40ab68fe85ac None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:38.276498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:38.445329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9462c-4d34-4fa9-a0d2-40ab68fe85ac None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:38.478865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 12:42:37 2022] POST /identity/v3/roles => generated 225 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:42:38.481248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23395-e9fe-4e7b-8da0-8b0ceb6d73d9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:38.481549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23395-e9fe-4e7b-8da0-8b0ceb6d73d9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:38.481997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23395-e9fe-4e7b-8da0-8b0ceb6d73d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:38.492552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346c237-776b-48cc-98e6-d97c790caef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:38.494209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346c237-776b-48cc-98e6-d97c790caef1 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:38.494650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346c237-776b-48cc-98e6-d97c790caef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:38.495075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346c237-776b-48cc-98e6-d97c790caef1 None admin] PATH_INFO: `/v3/domains/default/users/037e9f95a2ad44f08247184b10274c13/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:38.498288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346c237-776b-48cc-98e6-d97c790caef1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=037e9f95a2ad44f08247184b10274c13, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:38.501403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346c237-776b-48cc-98e6-d97c790caef1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:38.510711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5ef23395-e9fe-4e7b-8da0-8b0ceb6d73d9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:38.517842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5ef23395-e9fe-4e7b-8da0-8b0ceb6d73d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:38.528055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 21/40] 10.222.0.48 () {58 vars in 1361 bytes} [Fri Jun 17 12:42:38 2022] PUT /identity/v3/domains/default/users/037e9f95a2ad44f08247184b10274c13/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:42:38.529417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b82d2d-ba4b-4c83-a656-d51bbfc3580e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:38.529767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b82d2d-ba4b-4c83-a656-d51bbfc3580e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:38.530003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b82d2d-ba4b-4c83-a656-d51bbfc3580e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:38.532049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 22/41] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:38.538292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c3417-37d5-47e4-92c0-fd89e8da6d9f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:38.538639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c3417-37d5-47e4-92c0-fd89e8da6d9f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:38.538842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c3417-37d5-47e4-92c0-fd89e8da6d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:38.567604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-424c3417-37d5-47e4-92c0-fd89e8da6d9f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:38.569654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-424c3417-37d5-47e4-92c0-fd89e8da6d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:38.638240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 20/42] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:38.661777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef23395-e9fe-4e7b-8da0-8b0ceb6d73d9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:38.679153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:38.691494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 23/43] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:42:38.718843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c3417-37d5-47e4-92c0-fd89e8da6d9f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:38.733446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:38.821542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef23395-e9fe-4e7b-8da0-8b0ceb6d73d9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:38.871148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca71f-c9dd-4a70-b667-0f7280237898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:38.871830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca71f-c9dd-4a70-b667-0f7280237898 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:38.872271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca71f-c9dd-4a70-b667-0f7280237898 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:38.872862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca71f-c9dd-4a70-b667-0f7280237898 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:38.873778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eca71f-c9dd-4a70-b667-0f7280237898 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:38.875875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eca71f-c9dd-4a70-b667-0f7280237898 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:38.882304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c3417-37d5-47e4-92c0-fd89e8da6d9f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:38.892858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 21/44] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 12:42:38 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:42:38.945357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e9ff2-2fbe-49fe-ac5b-436f6ca0e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:38.946296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e9ff2-2fbe-49fe-ac5b-436f6ca0e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:38.946602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e9ff2-2fbe-49fe-ac5b-436f6ca0e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:38.946889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e9ff2-2fbe-49fe-ac5b-436f6ca0e8f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:38.948214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e9ff2-2fbe-49fe-ac5b-436f6ca0e8f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:38.949827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e9ff2-2fbe-49fe-ac5b-436f6ca0e8f2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:38.952777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 24/45] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:38.962138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca71f-c9dd-4a70-b667-0f7280237898 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:39.112759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca71f-c9dd-4a70-b667-0f7280237898 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:39.115091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:39.171592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30863f2-0218-4c47-9bf2-01e92860ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:39.172377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30863f2-0218-4c47-9bf2-01e92860ea79 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:39.172664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30863f2-0218-4c47-9bf2-01e92860ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:39.172979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30863f2-0218-4c47-9bf2-01e92860ea79 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:39.173807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30863f2-0218-4c47-9bf2-01e92860ea79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:39.175538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30863f2-0218-4c47-9bf2-01e92860ea79 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:39.208843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:42:38 2022] POST /identity/v3/projects => generated 312 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:42:40.868777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf521392-f8e2-4fd7-8542-cfbf75201ec8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:40.869334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf521392-f8e2-4fd7-8542-cfbf75201ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:40.869594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf521392-f8e2-4fd7-8542-cfbf75201ec8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:40.871610 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:40.877737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086b036-1d77-4396-a42b-ffacfcf839cc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:40.878462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086b036-1d77-4396-a42b-ffacfcf839cc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:40.878462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086b036-1d77-4396-a42b-ffacfcf839cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:40.900003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8086b036-1d77-4396-a42b-ffacfcf839cc None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:40.901293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8086b036-1d77-4396-a42b-ffacfcf839cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:40.980140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:41.005833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf521392-f8e2-4fd7-8542-cfbf75201ec8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:41.087613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:41.128525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf521392-f8e2-4fd7-8542-cfbf75201ec8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:41.173037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7b5c7-ab64-48bb-979d-f2732818d7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:41.173879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7b5c7-ab64-48bb-979d-f2732818d7db None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:41.174191 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7b5c7-ab64-48bb-979d-f2732818d7db None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:41.174473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7b5c7-ab64-48bb-979d-f2732818d7db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:41.187642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7b5c7-ab64-48bb-979d-f2732818d7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-92e7b5c7-ab64-48bb-979d-f2732818d7db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:41.197400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:41.198583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:41.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:42:41.202508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 26/49] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:41.204634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086b036-1d77-4396-a42b-ffacfcf839cc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:41.302372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:41.326194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086b036-1d77-4396-a42b-ffacfcf839cc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:41.375530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23692214-69c0-4547-b6fd-f83516d66459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:41.376219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23692214-69c0-4547-b6fd-f83516d66459 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:41.376503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23692214-69c0-4547-b6fd-f83516d66459 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:41.376783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23692214-69c0-4547-b6fd-f83516d66459 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:41.377575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23692214-69c0-4547-b6fd-f83516d66459 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:41.377887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23692214-69c0-4547-b6fd-f83516d66459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:41.379468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23692214-69c0-4547-b6fd-f83516d66459 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:41.389872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 24/50] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:41.396085 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7b5c7-ab64-48bb-979d-f2732818d7db None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:41.500953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d4e02-cd76-48fb-86e2-de1f347a87f1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:41.501247 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d4e02-cd76-48fb-86e2-de1f347a87f1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:41.501539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d4e02-cd76-48fb-86e2-de1f347a87f1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:41.503104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 25/51] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:42:41.509519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732168f-e94a-49bd-a20c-0b05271b2912 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:41.509890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732168f-e94a-49bd-a20c-0b05271b2912 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:41.510225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732168f-e94a-49bd-a20c-0b05271b2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:41.529463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e732168f-e94a-49bd-a20c-0b05271b2912 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:41.535151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e732168f-e94a-49bd-a20c-0b05271b2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:41.536719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7b5c7-ab64-48bb-979d-f2732818d7db None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:41.576600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:41.590042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c4cee-bb80-4242-ad19-624f0d9fd4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:41.591108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c4cee-bb80-4242-ad19-624f0d9fd4ab None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:41.591402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c4cee-bb80-4242-ad19-624f0d9fd4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:41.591684 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c4cee-bb80-4242-ad19-624f0d9fd4ab None admin] PATH_INFO: `/v3/users/037e9f95a2ad44f08247184b10274c13` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:41.593002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c4cee-bb80-4242-ad19-624f0d9fd4ab None admin] RBAC: Authorizing `identity:get_user(user_id=037e9f95a2ad44f08247184b10274c13)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:41.594602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c4cee-bb80-4242-ad19-624f0d9fd4ab None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:41.596540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:41 2022] GET /identity/v3/users/037e9f95a2ad44f08247184b10274c13 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:41.603066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c4cee-bb80-4242-ad19-624f0d9fd4ab None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:41.642545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 26/53] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:42:41.672216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732168f-e94a-49bd-a20c-0b05271b2912 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:41.748522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c4cee-bb80-4242-ad19-624f0d9fd4ab None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:41.777010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:41.790071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac52f1-46df-417b-b28e-d09582068856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:41.791022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac52f1-46df-417b-b28e-d09582068856 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:41.791302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac52f1-46df-417b-b28e-d09582068856 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:41.791582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac52f1-46df-417b-b28e-d09582068856 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:41.792898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac52f1-46df-417b-b28e-d09582068856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:41.794484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac52f1-46df-417b-b28e-d09582068856 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:41.796446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:41.802898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac52f1-46df-417b-b28e-d09582068856 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:41.806475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732168f-e94a-49bd-a20c-0b05271b2912 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:41.870180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a135a5-ee53-4515-8bdd-abdc20d07c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:41.871035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a135a5-ee53-4515-8bdd-abdc20d07c60 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:41.871322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a135a5-ee53-4515-8bdd-abdc20d07c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:41.871601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a135a5-ee53-4515-8bdd-abdc20d07c60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:41.872917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a135a5-ee53-4515-8bdd-abdc20d07c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:41.874492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a135a5-ee53-4515-8bdd-abdc20d07c60 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:41.876651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:41.886460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a135a5-ee53-4515-8bdd-abdc20d07c60 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:41.892225 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:41.941472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac52f1-46df-417b-b28e-d09582068856 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:41.988222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc687fe-d73d-47c7-96f2-0b31d986948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:41.988983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc687fe-d73d-47c7-96f2-0b31d986948e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:41.989245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc687fe-d73d-47c7-96f2-0b31d986948e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:41.989530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc687fe-d73d-47c7-96f2-0b31d986948e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:41.990578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc687fe-d73d-47c7-96f2-0b31d986948e None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.domain.id=default, user.id=037e9f95a2ad44f08247184b10274c13) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:41.990896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc687fe-d73d-47c7-96f2-0b31d986948e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:41.992570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc687fe-d73d-47c7-96f2-0b31d986948e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:42.004335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Jun 17 12:42:41 2022] GET /identity/v3/role_assignments?user.id=037e9f95a2ad44f08247184b10274c13&scope.domain.id=default&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 530 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:42.010971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a135a5-ee53-4515-8bdd-abdc20d07c60 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:42.065477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b599bb-94c6-4588-b840-1ac828d7b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:42.066852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b599bb-94c6-4588-b840-1ac828d7b28a None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:42.067553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b599bb-94c6-4588-b840-1ac828d7b28a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:42.068118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b599bb-94c6-4588-b840-1ac828d7b28a None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:42.070053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b599bb-94c6-4588-b840-1ac828d7b28a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:42.073748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b599bb-94c6-4588-b840-1ac828d7b28a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:42.101222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:42.125708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 28/57] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Jun 17 12:42:41 2022] POST /identity/v3/projects => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:42:44.440751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0e644-69a4-4d79-b2e8-e020e6861ec4 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:44.441449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0e644-69a4-4d79-b2e8-e020e6861ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:44.441449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0e644-69a4-4d79-b2e8-e020e6861ec4 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:44.442968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:44.449533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a669a-7132-4462-82ef-b0bb3e6a5e98 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:44.450071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a669a-7132-4462-82ef-b0bb3e6a5e98 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:44.450071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a669a-7132-4462-82ef-b0bb3e6a5e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:44.470654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0a5a669a-7132-4462-82ef-b0bb3e6a5e98 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:44.471883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0a5a669a-7132-4462-82ef-b0bb3e6a5e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:44.551569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:44.576895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0e644-69a4-4d79-b2e8-e020e6861ec4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:44.691440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0e644-69a4-4d79-b2e8-e020e6861ec4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:44.721297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:44.730217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d0ed5-13e3-4a69-bd08-5e036ea6af1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:44.731059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d0ed5-13e3-4a69-bd08-5e036ea6af1a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:44.731341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d0ed5-13e3-4a69-bd08-5e036ea6af1a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:44.731619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d0ed5-13e3-4a69-bd08-5e036ea6af1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:44.732894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d0ed5-13e3-4a69-bd08-5e036ea6af1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:44.734478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d0ed5-13e3-4a69-bd08-5e036ea6af1a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:44.736553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:44.743314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a669a-7132-4462-82ef-b0bb3e6a5e98 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:44.852144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a669a-7132-4462-82ef-b0bb3e6a5e98 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:44.884137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:44.894720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bb142-93b2-47b5-bafe-9a7478d3d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:44.895582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bb142-93b2-47b5-bafe-9a7478d3d4f3 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:44.895948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bb142-93b2-47b5-bafe-9a7478d3d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:44.896301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bb142-93b2-47b5-bafe-9a7478d3d4f3 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:44.897447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bb142-93b2-47b5-bafe-9a7478d3d4f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:44.900278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bb142-93b2-47b5-bafe-9a7478d3d4f3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:44.927716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:42:44 2022] POST /identity/v3/users => generated 275 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:42:48.425465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c174cf-0d8d-4e4d-b594-4a296bf3ebfb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:48.426016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c174cf-0d8d-4e4d-b594-4a296bf3ebfb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:48.426016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c174cf-0d8d-4e4d-b594-4a296bf3ebfb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:48.427452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:48.440627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93545-d40b-4248-afc7-8a13762b166e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:48.441178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93545-d40b-4248-afc7-8a13762b166e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:48.441178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93545-d40b-4248-afc7-8a13762b166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:48.462708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a4a93545-d40b-4248-afc7-8a13762b166e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:48.463951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a4a93545-d40b-4248-afc7-8a13762b166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:48.506132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9538b-526c-44b4-8a34-b0d329cd1b2c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:48.506450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9538b-526c-44b4-8a34-b0d329cd1b2c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:48.506731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9538b-526c-44b4-8a34-b0d329cd1b2c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:48.508135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 33/63] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:42:48.513657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0e6fb-e5aa-44d2-bf94-1c02f2682d1a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:48.514147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0e6fb-e5aa-44d2-bf94-1c02f2682d1a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:48.514558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0e6fb-e5aa-44d2-bf94-1c02f2682d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:48.544505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-64a0e6fb-e5aa-44d2-bf94-1c02f2682d1a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:48.547240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-64a0e6fb-e5aa-44d2-bf94-1c02f2682d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:48.592496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 31/64] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:48.632441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26793e7-a145-40ea-a147-37647003b0bd None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:48.633095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26793e7-a145-40ea-a147-37647003b0bd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:48.633539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26793e7-a145-40ea-a147-37647003b0bd None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:48.635261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 32/65] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:42:48.636300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26793e7-a145-40ea-a147-37647003b0bd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:48.669325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 34/66] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:42:48.674216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977953b-ea9b-43fa-9880-3bf5ba372467 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:48.674216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977953b-ea9b-43fa-9880-3bf5ba372467 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:48.674216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977953b-ea9b-43fa-9880-3bf5ba372467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:48.689133 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4977953b-ea9b-43fa-9880-3bf5ba372467 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:48.690599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4977953b-ea9b-43fa-9880-3bf5ba372467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:48.782115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 35/67] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:48.782115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977953b-ea9b-43fa-9880-3bf5ba372467 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:48.811922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26793e7-a145-40ea-a147-37647003b0bd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:48.828024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:48.853103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:48.855489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bb72a-bfa0-44ce-84c5-e16918cdf31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:48.856683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bb72a-bfa0-44ce-84c5-e16918cdf31c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:48.857193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bb72a-bfa0-44ce-84c5-e16918cdf31c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:48.857664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bb72a-bfa0-44ce-84c5-e16918cdf31c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:48.871999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bb72a-bfa0-44ce-84c5-e16918cdf31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-317bb72a-bfa0-44ce-84c5-e16918cdf31c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:48.881602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:48.882725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:48.883491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:48.886045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 33/68] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:48.892288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bb72a-bfa0-44ce-84c5-e16918cdf31c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:48.914344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977953b-ea9b-43fa-9880-3bf5ba372467 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:48.960748 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbb0c3-2bbc-46f3-b96b-da124867434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:48.961611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbb0c3-2bbc-46f3-b96b-da124867434c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:48.961895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbb0c3-2bbc-46f3-b96b-da124867434c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:48.962211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbb0c3-2bbc-46f3-b96b-da124867434c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:48.976929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbb0c3-2bbc-46f3-b96b-da124867434c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-43dbb0c3-2bbc-46f3-b96b-da124867434c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:48.985391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:48.986940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 36/69] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:48.992852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbb0c3-2bbc-46f3-b96b-da124867434c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.014635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bb72a-bfa0-44ce-84c5-e16918cdf31c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.050997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae17387-9ba8-4bb8-8e38-7fabad2a8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.051835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae17387-9ba8-4bb8-8e38-7fabad2a8c87 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.052119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae17387-9ba8-4bb8-8e38-7fabad2a8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.052399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae17387-9ba8-4bb8-8e38-7fabad2a8c87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.063738 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae17387-9ba8-4bb8-8e38-7fabad2a8c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dae17387-9ba8-4bb8-8e38-7fabad2a8c87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:49.072640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:49.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:49.075097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 34/70] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:42:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:49.076041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d84d41-04b7-4a68-a6e7-04dec82d4cfa None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.076041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d84d41-04b7-4a68-a6e7-04dec82d4cfa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.076041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d84d41-04b7-4a68-a6e7-04dec82d4cfa None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.081899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 35/71] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:49.081899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d84d41-04b7-4a68-a6e7-04dec82d4cfa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.104769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbb0c3-2bbc-46f3-b96b-da124867434c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.117701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:49.124209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:49.143388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60c0b5-bcb5-4f18-ad7a-c2bbd6f1385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.144095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60c0b5-bcb5-4f18-ad7a-c2bbd6f1385b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.144384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60c0b5-bcb5-4f18-ad7a-c2bbd6f1385b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.144663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60c0b5-bcb5-4f18-ad7a-c2bbd6f1385b None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.145431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60c0b5-bcb5-4f18-ad7a-c2bbd6f1385b None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:49.145739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60c0b5-bcb5-4f18-ad7a-c2bbd6f1385b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:49.147545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60c0b5-bcb5-4f18-ad7a-c2bbd6f1385b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:49.156351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 37/72] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:49.157667 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8721-b6cc-4ab7-8b85-de200cbcd34d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.157960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8721-b6cc-4ab7-8b85-de200cbcd34d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.158283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8721-b6cc-4ab7-8b85-de200cbcd34d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.159526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 38/73] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:49.160571 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0866dc-e85e-433c-b905-2e867ebe7e67 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.161117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0866dc-e85e-433c-b905-2e867ebe7e67 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.161117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0866dc-e85e-433c-b905-2e867ebe7e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.179841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-df0866dc-e85e-433c-b905-2e867ebe7e67 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:49.181089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-df0866dc-e85e-433c-b905-2e867ebe7e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:49.198846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d84d41-04b7-4a68-a6e7-04dec82d4cfa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.234072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be1544-167f-49ba-9a59-626d16733fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.234800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be1544-167f-49ba-9a59-626d16733fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.235094 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be1544-167f-49ba-9a59-626d16733fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.235381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be1544-167f-49ba-9a59-626d16733fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.236929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be1544-167f-49ba-9a59-626d16733fa1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:49.237405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be1544-167f-49ba-9a59-626d16733fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:49.238886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be1544-167f-49ba-9a59-626d16733fa1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:49.247797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 36/74] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:49.248717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be1544-167f-49ba-9a59-626d16733fa1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.254291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 39/75] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:49.254291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0866dc-e85e-433c-b905-2e867ebe7e67 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.346788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:49.353499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0866dc-e85e-433c-b905-2e867ebe7e67 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.354303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be1544-167f-49ba-9a59-626d16733fa1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.364555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:49.392712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883c39-d7c8-4934-8d3e-c58bfb7c455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.393640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883c39-d7c8-4934-8d3e-c58bfb7c455b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.393916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883c39-d7c8-4934-8d3e-c58bfb7c455b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.394019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4055cf-37ef-418c-9b32-1df4997c3298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.394236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883c39-d7c8-4934-8d3e-c58bfb7c455b None admin] PATH_INFO: `/v3/users/9d6b6818f3464d67ac88d0437368dd05` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.394648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4055cf-37ef-418c-9b32-1df4997c3298 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.394936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4055cf-37ef-418c-9b32-1df4997c3298 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.395221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4055cf-37ef-418c-9b32-1df4997c3298 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.396005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4055cf-37ef-418c-9b32-1df4997c3298 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:49.396317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4055cf-37ef-418c-9b32-1df4997c3298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:49.397927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4055cf-37ef-418c-9b32-1df4997c3298 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:49.406080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 37/76] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:42:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:49.407343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2f811-ad56-4c69-95b6-698e6c6a23f6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.407636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2f811-ad56-4c69-95b6-698e6c6a23f6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.407925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2f811-ad56-4c69-95b6-698e6c6a23f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.411907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0883c39-d7c8-4934-8d3e-c58bfb7c455b None admin] RBAC: Authorizing `identity:get_user(user_id=9d6b6818f3464d67ac88d0437368dd05)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:49.413867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0883c39-d7c8-4934-8d3e-c58bfb7c455b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:49.415653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 40/77] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:49 2022] GET /identity/v3/users/9d6b6818f3464d67ac88d0437368dd05 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:49.416423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883c39-d7c8-4934-8d3e-c58bfb7c455b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.426009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-07e2f811-ad56-4c69-95b6-698e6c6a23f6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:49.427242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-07e2f811-ad56-4c69-95b6-698e6c6a23f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:49.496983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 38/78] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:49.497910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2f811-ad56-4c69-95b6-698e6c6a23f6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.528449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883c39-d7c8-4934-8d3e-c58bfb7c455b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.567677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1728-c9e2-42c9-89c3-ab40ef48a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.568614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1728-c9e2-42c9-89c3-ab40ef48a09f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.568935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1728-c9e2-42c9-89c3-ab40ef48a09f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.569193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1728-c9e2-42c9-89c3-ab40ef48a09f None admin] PATH_INFO: `/v3/users/037e9f95a2ad44f08247184b10274c13` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.570504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1728-c9e2-42c9-89c3-ab40ef48a09f None admin] RBAC: Authorizing `identity:get_user(user_id=037e9f95a2ad44f08247184b10274c13)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:49.572052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1728-c9e2-42c9-89c3-ab40ef48a09f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:49.573936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 41/79] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:49 2022] GET /identity/v3/users/037e9f95a2ad44f08247184b10274c13 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:49.574717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1728-c9e2-42c9-89c3-ab40ef48a09f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.602250 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:49.612247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:49.619911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2f811-ad56-4c69-95b6-698e6c6a23f6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.656489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53de2d-1b7e-4c0f-80ac-42b5c5585c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.657316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53de2d-1b7e-4c0f-80ac-42b5c5585c6e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.657597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53de2d-1b7e-4c0f-80ac-42b5c5585c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.657873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53de2d-1b7e-4c0f-80ac-42b5c5585c6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.659100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53de2d-1b7e-4c0f-80ac-42b5c5585c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:49.660608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53de2d-1b7e-4c0f-80ac-42b5c5585c6e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:49.662483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 39/80] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:49.663171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53de2d-1b7e-4c0f-80ac-42b5c5585c6e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.685811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1728-c9e2-42c9-89c3-ab40ef48a09f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.722835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a0c95-bdcd-492a-9292-af50ad6b4271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.723741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a0c95-bdcd-492a-9292-af50ad6b4271 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.724066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a0c95-bdcd-492a-9292-af50ad6b4271 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.724302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a0c95-bdcd-492a-9292-af50ad6b4271 None admin] PATH_INFO: `/v3/users/9d6b6818f3464d67ac88d0437368dd05` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.725721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a0c95-bdcd-492a-9292-af50ad6b4271 None admin] RBAC: Authorizing `identity:get_user(user_id=9d6b6818f3464d67ac88d0437368dd05)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:49.727275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a0c95-bdcd-492a-9292-af50ad6b4271 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:49.728959 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 42/81] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:49 2022] GET /identity/v3/users/9d6b6818f3464d67ac88d0437368dd05 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:49.729713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a0c95-bdcd-492a-9292-af50ad6b4271 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.782578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53de2d-1b7e-4c0f-80ac-42b5c5585c6e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.816619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a71c05-462d-4f4e-b482-c4e4f34e8dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.817293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a71c05-462d-4f4e-b482-c4e4f34e8dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.817689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a71c05-462d-4f4e-b482-c4e4f34e8dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.817865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a71c05-462d-4f4e-b482-c4e4f34e8dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.838341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a0c95-bdcd-492a-9292-af50ad6b4271 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:49.840093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:49.843039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:49.876072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f1d06-fe66-4adb-9c60-730aed6e5723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:49.876924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1d06-fe66-4adb-9c60-730aed6e5723 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:49.877184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1d06-fe66-4adb-9c60-730aed6e5723 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:49.877457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f1d06-fe66-4adb-9c60-730aed6e5723 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:49.887675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f1d06-fe66-4adb-9c60-730aed6e5723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:49.888167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a71c05-462d-4f4e-b482-c4e4f34e8dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:49.889698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a71c05-462d-4f4e-b482-c4e4f34e8dd5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a55f1d06-fe66-4adb-9c60-730aed6e5723 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:49.896262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:49.897458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:42:49.898270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 43/82] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:49.898879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f1d06-fe66-4adb-9c60-730aed6e5723 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:49.997756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 40/83] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:42:49.998636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a71c05-462d-4f4e-b482-c4e4f34e8dd5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:50.019697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f1d06-fe66-4adb-9c60-730aed6e5723 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:50.060797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e969ae0-54f5-496a-a31c-eb2dcce324d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:50.061472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e969ae0-54f5-496a-a31c-eb2dcce324d3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:50.061759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e969ae0-54f5-496a-a31c-eb2dcce324d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:50.062041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e969ae0-54f5-496a-a31c-eb2dcce324d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:50.062604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:50.098351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:50.116183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a71c05-462d-4f4e-b482-c4e4f34e8dd5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:50.145065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e969ae0-54f5-496a-a31c-eb2dcce324d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:50.146626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e969ae0-54f5-496a-a31c-eb2dcce324d3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:50.158834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501de49-7892-4e30-be77-74156f220978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:50.159584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501de49-7892-4e30-be77-74156f220978 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:50.159909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501de49-7892-4e30-be77-74156f220978 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:50.160191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501de49-7892-4e30-be77-74156f220978 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:50.160950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501de49-7892-4e30-be77-74156f220978 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:50.162597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501de49-7892-4e30-be77-74156f220978 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:50.185229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 41/84] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:42:49 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:42:50.186101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501de49-7892-4e30-be77-74156f220978 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:50.284798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 44/85] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:42:50.286183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e969ae0-54f5-496a-a31c-eb2dcce324d3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:50.325942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501de49-7892-4e30-be77-74156f220978 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:50.338394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:50.368970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:50.375835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f701-237a-478a-ae2b-ca5680b1798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:50.376994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f701-237a-478a-ae2b-ca5680b1798c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:50.377498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f701-237a-478a-ae2b-ca5680b1798c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:50.377992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f701-237a-478a-ae2b-ca5680b1798c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:50.423521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e969ae0-54f5-496a-a31c-eb2dcce324d3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:50.470823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221f701-237a-478a-ae2b-ca5680b1798c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:50.472095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41851751-f807-49db-a8e3-caac6eb412f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:50.472417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221f701-237a-478a-ae2b-ca5680b1798c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:50.472799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41851751-f807-49db-a8e3-caac6eb412f7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:50.473087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41851751-f807-49db-a8e3-caac6eb412f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:50.473362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41851751-f807-49db-a8e3-caac6eb412f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:50.474206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41851751-f807-49db-a8e3-caac6eb412f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:50.474809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41851751-f807-49db-a8e3-caac6eb412f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:50.477225 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41851751-f807-49db-a8e3-caac6eb412f7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:50.490941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 45/86] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:50.491831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41851751-f807-49db-a8e3-caac6eb412f7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:50.618671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 42/87] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:42:50.619892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f701-237a-478a-ae2b-ca5680b1798c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:50.636846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:50.645108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41851751-f807-49db-a8e3-caac6eb412f7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:50.673785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:50.687691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9561b3-5223-4f49-8f61-3fea537e9b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:50.688834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9561b3-5223-4f49-8f61-3fea537e9b41 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:50.689222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9561b3-5223-4f49-8f61-3fea537e9b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:50.689599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9561b3-5223-4f49-8f61-3fea537e9b41 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:50.691003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9561b3-5223-4f49-8f61-3fea537e9b41 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:50.692668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9561b3-5223-4f49-8f61-3fea537e9b41 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:50.695798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 46/88] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:50 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:50.696644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9561b3-5223-4f49-8f61-3fea537e9b41 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:50.750985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f701-237a-478a-ae2b-ca5680b1798c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:50.789881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee30a6-c0ca-45c2-b5e7-ec67f76a392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:50.790827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee30a6-c0ca-45c2-b5e7-ec67f76a392f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:50.791115 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee30a6-c0ca-45c2-b5e7-ec67f76a392f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:50.791399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee30a6-c0ca-45c2-b5e7-ec67f76a392f None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:50.792687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee30a6-c0ca-45c2-b5e7-ec67f76a392f None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:50.794296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee30a6-c0ca-45c2-b5e7-ec67f76a392f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:50.796276 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 43/89] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:50 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:50.796912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee30a6-c0ca-45c2-b5e7-ec67f76a392f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:50.834702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9561b3-5223-4f49-8f61-3fea537e9b41 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:50.877349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a2e0-0d3e-457f-a7d7-cf1b08028986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:50.878450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a2e0-0d3e-457f-a7d7-cf1b08028986 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:50.878805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a2e0-0d3e-457f-a7d7-cf1b08028986 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:50.879153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a2e0-0d3e-457f-a7d7-cf1b08028986 None admin] PATH_INFO: `/v3/users/9d6b6818f3464d67ac88d0437368dd05` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:50.880536 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a2e0-0d3e-457f-a7d7-cf1b08028986 None admin] RBAC: Authorizing `identity:get_user(user_id=9d6b6818f3464d67ac88d0437368dd05)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:50.882744 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a2e0-0d3e-457f-a7d7-cf1b08028986 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:50.884843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 47/90] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:50 2022] GET /identity/v3/users/9d6b6818f3464d67ac88d0437368dd05 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:50.890025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a2e0-0d3e-457f-a7d7-cf1b08028986 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:50.898501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:50.919354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee30a6-c0ca-45c2-b5e7-ec67f76a392f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:50.961443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:50.967208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a67bc-1022-46a6-b4a5-a8055d06b826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:50.969186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a67bc-1022-46a6-b4a5-a8055d06b826 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:50.969859 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a67bc-1022-46a6-b4a5-a8055d06b826 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:50.970856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a67bc-1022-46a6-b4a5-a8055d06b826 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:50.974329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a67bc-1022-46a6-b4a5-a8055d06b826 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:50.978798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a67bc-1022-46a6-b4a5-a8055d06b826 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:50.983137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 44/91] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:50 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:50.985420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a67bc-1022-46a6-b4a5-a8055d06b826 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:51.015147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a2e0-0d3e-457f-a7d7-cf1b08028986 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:51.054934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89f7b6-8509-42a0-b700-968ae3789e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:51.056018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89f7b6-8509-42a0-b700-968ae3789e7a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:51.056520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89f7b6-8509-42a0-b700-968ae3789e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:51.057002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89f7b6-8509-42a0-b700-968ae3789e7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:51.058058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89f7b6-8509-42a0-b700-968ae3789e7a None admin] RBAC: Adding query filter params (role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=255f1d6d50524cb9927e19bc3f010eae, user.id=9d6b6818f3464d67ac88d0437368dd05) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:51.058625 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89f7b6-8509-42a0-b700-968ae3789e7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:51.060361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89f7b6-8509-42a0-b700-968ae3789e7a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:51.068217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 48/92] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:42:50 2022] GET /identity/v3/role_assignments?user.id=9d6b6818f3464d67ac88d0437368dd05&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=3d852826ac0a4f09b618a220333f2897 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:51.070122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89f7b6-8509-42a0-b700-968ae3789e7a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:51.142123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a67bc-1022-46a6-b4a5-a8055d06b826 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:51.195131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e38cf7-1896-466a-be95-6003d9fb318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:51.195837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e38cf7-1896-466a-be95-6003d9fb318d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:51.196170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e38cf7-1896-466a-be95-6003d9fb318d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:51.196413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e38cf7-1896-466a-be95-6003d9fb318d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:51.197279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e38cf7-1896-466a-be95-6003d9fb318d None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=255f1d6d50524cb9927e19bc3f010eae, user.id=037e9f95a2ad44f08247184b10274c13) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:51.197614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e38cf7-1896-466a-be95-6003d9fb318d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:51.199203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e38cf7-1896-466a-be95-6003d9fb318d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:51.220464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 45/93] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:42:50 2022] GET /identity/v3/role_assignments?user.id=037e9f95a2ad44f08247184b10274c13&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:51.220464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e38cf7-1896-466a-be95-6003d9fb318d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:51.250321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:51.296285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89f7b6-8509-42a0-b700-968ae3789e7a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:51.354327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:51.387866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163470c9-92d2-4088-aac5-807ac55abfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:51.387866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163470c9-92d2-4088-aac5-807ac55abfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:51.387866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163470c9-92d2-4088-aac5-807ac55abfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:51.387866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163470c9-92d2-4088-aac5-807ac55abfa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:51.480434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e38cf7-1896-466a-be95-6003d9fb318d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:51.548393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3321a-6ede-44d0-8123-3f1df9ce2eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:51.549578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3321a-6ede-44d0-8123-3f1df9ce2eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:51.550046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3321a-6ede-44d0-8123-3f1df9ce2eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:51.550589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3321a-6ede-44d0-8123-3f1df9ce2eb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:51.551977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3321a-6ede-44d0-8123-3f1df9ce2eb4 None admin] RBAC: Adding query filter params (role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=255f1d6d50524cb9927e19bc3f010eae, user.id=9d6b6818f3464d67ac88d0437368dd05) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:51.555722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3321a-6ede-44d0-8123-3f1df9ce2eb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:51.558259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3321a-6ede-44d0-8123-3f1df9ce2eb4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:51.586398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 46/94] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:42:51 2022] GET /identity/v3/role_assignments?user.id=9d6b6818f3464d67ac88d0437368dd05&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=1a772cde30724b09b110b5dffecfd462 => generated 259 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:51.594075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163470c9-92d2-4088-aac5-807ac55abfa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:51.597209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163470c9-92d2-4088-aac5-807ac55abfa6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:51.762715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 49/95] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:42:51.768471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3321a-6ede-44d0-8123-3f1df9ce2eb4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:51.880096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:51.909974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3321a-6ede-44d0-8123-3f1df9ce2eb4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:51.952683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d97ee-e2f8-4272-9094-f30a16ce16f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:51.953603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d97ee-e2f8-4272-9094-f30a16ce16f8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:51.953892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d97ee-e2f8-4272-9094-f30a16ce16f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:51.954198 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d97ee-e2f8-4272-9094-f30a16ce16f8 None admin] PATH_INFO: `/v3/projects/d2a921eabd6648f487d0ed2607e6ec16` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:51.959045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d97ee-e2f8-4272-9094-f30a16ce16f8 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a921eabd6648f487d0ed2607e6ec16)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:51.961026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d97ee-e2f8-4272-9094-f30a16ce16f8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:51.964035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 47/96] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:51 2022] GET /identity/v3/projects/d2a921eabd6648f487d0ed2607e6ec16 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:51.970937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163470c9-92d2-4088-aac5-807ac55abfa6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:52.006850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:52.133405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163470c9-92d2-4088-aac5-807ac55abfa6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:52.183770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999482a3-d135-47cc-9dec-bd9648183a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:52.184470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999482a3-d135-47cc-9dec-bd9648183a4f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:52.184763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999482a3-d135-47cc-9dec-bd9648183a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:52.185046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999482a3-d135-47cc-9dec-bd9648183a4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:52.185901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999482a3-d135-47cc-9dec-bd9648183a4f None admin] RBAC: Adding query filter params (role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=d2a921eabd6648f487d0ed2607e6ec16, user.id=9d6b6818f3464d67ac88d0437368dd05) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:52.186258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999482a3-d135-47cc-9dec-bd9648183a4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:52.187776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999482a3-d135-47cc-9dec-bd9648183a4f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:52.194620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 50/97] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:42:51 2022] GET /identity/v3/role_assignments?user.id=9d6b6818f3464d67ac88d0437368dd05&scope.project.id=d2a921eabd6648f487d0ed2607e6ec16&role.id=3d852826ac0a4f09b618a220333f2897 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:52.903925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e5e9-666d-4435-87f9-18ea6606f8f2 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:52.904446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e5e9-666d-4435-87f9-18ea6606f8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:52.904519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e5e9-666d-4435-87f9-18ea6606f8f2 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:52.906051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 48/98] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:52.920018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a779f-8cfa-47ae-be4b-5159a6ec19a2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:52.920687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a779f-8cfa-47ae-be4b-5159a6ec19a2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:52.920687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a779f-8cfa-47ae-be4b-5159a6ec19a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:52.945880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7e7a779f-8cfa-47ae-be4b-5159a6ec19a2 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:52.947156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7e7a779f-8cfa-47ae-be4b-5159a6ec19a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:53.040609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 51/99] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:42:53.079852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e5e9-666d-4435-87f9-18ea6606f8f2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:53.223120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e5e9-666d-4435-87f9-18ea6606f8f2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:53.279011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce7bbb-b40e-4220-8b6b-d6e0462d1d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:53.279885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7bbb-b40e-4220-8b6b-d6e0462d1d21 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:53.280182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7bbb-b40e-4220-8b6b-d6e0462d1d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:53.280461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7bbb-b40e-4220-8b6b-d6e0462d1d21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:53.299001 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce7bbb-b40e-4220-8b6b-d6e0462d1d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-50ce7bbb-b40e-4220-8b6b-d6e0462d1d21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:53.308148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:53.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:53.309877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 49/100] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:53.315648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a779f-8cfa-47ae-be4b-5159a6ec19a2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:53.350750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:53.408307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6af12-2fa8-4c21-9e98-0ad492c2418e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:53.408617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6af12-2fa8-4c21-9e98-0ad492c2418e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:53.408871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6af12-2fa8-4c21-9e98-0ad492c2418e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:53.410313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 50/101] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:42:53.433009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fe448-8d09-4b8a-889b-24a311dc84d6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:53.433342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fe448-8d09-4b8a-889b-24a311dc84d6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:53.433583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fe448-8d09-4b8a-889b-24a311dc84d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:53.453369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:53.483185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-236fe448-8d09-4b8a-889b-24a311dc84d6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:53.484346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-236fe448-8d09-4b8a-889b-24a311dc84d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:53.524273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a779f-8cfa-47ae-be4b-5159a6ec19a2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:53.634194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 51/102] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:42:53.643144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eff8d-67e7-46da-a6d7-a4d80fb1d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:53.643875 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eff8d-67e7-46da-a6d7-a4d80fb1d463 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:53.644163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eff8d-67e7-46da-a6d7-a4d80fb1d463 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:53.644444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eff8d-67e7-46da-a6d7-a4d80fb1d463 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:53.645226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423eff8d-67e7-46da-a6d7-a4d80fb1d463 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:53.645538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423eff8d-67e7-46da-a6d7-a4d80fb1d463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:53.647062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423eff8d-67e7-46da-a6d7-a4d80fb1d463 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:53.660936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 52/103] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:42:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:53.666807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fe448-8d09-4b8a-889b-24a311dc84d6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:53.693476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eff8d-67e7-46da-a6d7-a4d80fb1d463 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:53.888626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:53.902556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fe448-8d09-4b8a-889b-24a311dc84d6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:53.921380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eff8d-67e7-46da-a6d7-a4d80fb1d463 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:53.985838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c06f-7ae5-4783-9b88-68cd7ad76080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:53.987064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c06f-7ae5-4783-9b88-68cd7ad76080 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:53.987353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c06f-7ae5-4783-9b88-68cd7ad76080 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:53.987631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c06f-7ae5-4783-9b88-68cd7ad76080 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:53.995108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c06f-7ae5-4783-9b88-68cd7ad76080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:53.996663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c06f-7ae5-4783-9b88-68cd7ad76080 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:53.998773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 53/104] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:54.004839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c06f-7ae5-4783-9b88-68cd7ad76080 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:54.010453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:54.026808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdafbf-03a4-45f3-a2b4-d9ebb3e04c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:54.027740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdafbf-03a4-45f3-a2b4-d9ebb3e04c81 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:54.028032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdafbf-03a4-45f3-a2b4-d9ebb3e04c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:54.028310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdafbf-03a4-45f3-a2b4-d9ebb3e04c81 None admin] PATH_INFO: `/v3/users/b0a11d8c08574daab9ad9ae8d88a93e5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:54.062907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdafbf-03a4-45f3-a2b4-d9ebb3e04c81 None admin] RBAC: Authorizing `identity:get_user(user_id=b0a11d8c08574daab9ad9ae8d88a93e5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:54.064448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdafbf-03a4-45f3-a2b4-d9ebb3e04c81 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:54.066284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 52/105] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:53 2022] GET /identity/v3/users/b0a11d8c08574daab9ad9ae8d88a93e5 => generated 289 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:54.082558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdafbf-03a4-45f3-a2b4-d9ebb3e04c81 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:54.233779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c06f-7ae5-4783-9b88-68cd7ad76080 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:54.261487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdafbf-03a4-45f3-a2b4-d9ebb3e04c81 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:54.326601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2e0ae-b898-47c1-b322-a992d83acf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:54.327292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2e0ae-b898-47c1-b322-a992d83acf2f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:54.327584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2e0ae-b898-47c1-b322-a992d83acf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:54.327870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2e0ae-b898-47c1-b322-a992d83acf2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:54.329078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f4055-eaaf-49d7-9b3d-cd898bbd0022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:54.329757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f4055-eaaf-49d7-9b3d-cd898bbd0022 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:54.330042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f4055-eaaf-49d7-9b3d-cd898bbd0022 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:54.330638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f4055-eaaf-49d7-9b3d-cd898bbd0022 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:54.331370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f4055-eaaf-49d7-9b3d-cd898bbd0022 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:54.332890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f4055-eaaf-49d7-9b3d-cd898bbd0022 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:54.378973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:54.396016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 54/106] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:42:54 2022] POST /identity/v3/projects => generated 302 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:42:54.397966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d7d36-0321-47b0-97c3-df4be305e61e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:54.398469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d7d36-0321-47b0-97c3-df4be305e61e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:54.399041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d7d36-0321-47b0-97c3-df4be305e61e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:54.400814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 55/107] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:54.407755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339312-5944-4584-aeed-5308b95c1948 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:54.408051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339312-5944-4584-aeed-5308b95c1948 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:54.408402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339312-5944-4584-aeed-5308b95c1948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:54.439973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f9339312-5944-4584-aeed-5308b95c1948 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:54.441109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:54.441372 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f9339312-5944-4584-aeed-5308b95c1948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:54.458566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2e0ae-b898-47c1-b322-a992d83acf2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:54.460343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2e0ae-b898-47c1-b322-a992d83acf2f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:54.617614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 56/108] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:54.645066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 53/109] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 12:42:54.650909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9339312-5944-4584-aeed-5308b95c1948 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:54.662515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2e0ae-b898-47c1-b322-a992d83acf2f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:54.830453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:54.850708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2e0ae-b898-47c1-b322-a992d83acf2f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:54.873278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9339312-5944-4584-aeed-5308b95c1948 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:54.924076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2350de8-1473-4fff-bf63-e83983769eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:54.925578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2350de8-1473-4fff-bf63-e83983769eef None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:54.925944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2350de8-1473-4fff-bf63-e83983769eef None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:54.926319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2350de8-1473-4fff-bf63-e83983769eef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:54.949162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2350de8-1473-4fff-bf63-e83983769eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:54.954182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:54.965739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c94b36-9829-4f28-a3b7-542388e7e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:54.966722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c94b36-9829-4f28-a3b7-542388e7e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:54.967011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c94b36-9829-4f28-a3b7-542388e7e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:54.967295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c94b36-9829-4f28-a3b7-542388e7e4f6 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:54.968714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c94b36-9829-4f28-a3b7-542388e7e4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:54.970349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c94b36-9829-4f28-a3b7-542388e7e4f6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:54.972285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 57/110] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:54 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f2350de8-1473-4fff-bf63-e83983769eef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:54.973732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:54.974683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:54.975610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:54.981240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 54/111] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:54.982498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c94b36-9829-4f28-a3b7-542388e7e4f6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:54.984498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2350de8-1473-4fff-bf63-e83983769eef None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:55.135511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c94b36-9829-4f28-a3b7-542388e7e4f6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:55.141197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2350de8-1473-4fff-bf63-e83983769eef None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:55.181972 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de11c7-a4ef-4960-9d37-467a96d34beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:55.182414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de11c7-a4ef-4960-9d37-467a96d34beb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.182682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de11c7-a4ef-4960-9d37-467a96d34beb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.182958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de11c7-a4ef-4960-9d37-467a96d34beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.183830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de11c7-a4ef-4960-9d37-467a96d34beb None admin] RBAC: Adding query filter params (role.id=443ff5b7485a44109a9411b445079892, scope.project.id=255f1d6d50524cb9927e19bc3f010eae, user.id=b0a11d8c08574daab9ad9ae8d88a93e5) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:55.184141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de11c7-a4ef-4960-9d37-467a96d34beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:55.185704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de11c7-a4ef-4960-9d37-467a96d34beb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:55.192854 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 58/112] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:42:54 2022] GET /identity/v3/role_assignments?user.id=b0a11d8c08574daab9ad9ae8d88a93e5&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=443ff5b7485a44109a9411b445079892 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:55.194439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ece1a-20b9-4251-81db-68f4add81522 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.194621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ece1a-20b9-4251-81db-68f4add81522 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.194896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ece1a-20b9-4251-81db-68f4add81522 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.196533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 59/113] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:55.197787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8718-f929-425e-ac10-4e1c608d25da None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.198075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8718-f929-425e-ac10-4e1c608d25da None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.202859 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8718-f929-425e-ac10-4e1c608d25da None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.203075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20de3f-2b28-4d85-b53a-7243e706816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:55.204098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20de3f-2b28-4d85-b53a-7243e706816e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.204414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 60/114] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:55.204841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20de3f-2b28-4d85-b53a-7243e706816e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.205322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20de3f-2b28-4d85-b53a-7243e706816e None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.205717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5f0f-9ca4-401d-ba5c-1edb746796c4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.206004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5f0f-9ca4-401d-ba5c-1edb746796c4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.206322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5f0f-9ca4-401d-ba5c-1edb746796c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.207083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20de3f-2b28-4d85-b53a-7243e706816e None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:55.207597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20de3f-2b28-4d85-b53a-7243e706816e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:55.210244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20de3f-2b28-4d85-b53a-7243e706816e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:55.223104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 55/115] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:55.228559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a2701-c28d-4ce1-b68f-b99514a5ad8c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.228559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a2701-c28d-4ce1-b68f-b99514a5ad8c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.228559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a2701-c28d-4ce1-b68f-b99514a5ad8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.230583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-cd7a5f0f-9ca4-401d-ba5c-1edb746796c4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:55.231881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cd7a5f0f-9ca4-401d-ba5c-1edb746796c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:55.252753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-347a2701-c28d-4ce1-b68f-b99514a5ad8c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:55.254560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-347a2701-c28d-4ce1-b68f-b99514a5ad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:55.268056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:55.304030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:55.317549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 61/116] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:55.326822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5f0f-9ca4-401d-ba5c-1edb746796c4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:55.360121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 56/117] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:55.363051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b585f-766c-42bd-b043-d12a8d88a7c6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.363535 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b585f-766c-42bd-b043-d12a8d88a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.363906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b585f-766c-42bd-b043-d12a8d88a7c6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.366780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 57/118] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:55.367839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b585f-766c-42bd-b043-d12a8d88a7c6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:55.475018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5f0f-9ca4-401d-ba5c-1edb746796c4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:55.525459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b585f-766c-42bd-b043-d12a8d88a7c6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:55.531053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22a311-4507-434b-9f67-c11258188af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:55.532954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22a311-4507-434b-9f67-c11258188af1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.533678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22a311-4507-434b-9f67-c11258188af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.534390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22a311-4507-434b-9f67-c11258188af1 None admin] PATH_INFO: `/v3/users/9d6b6818f3464d67ac88d0437368dd05` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.536819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22a311-4507-434b-9f67-c11258188af1 None admin] RBAC: Authorizing `identity:get_user(user_id=9d6b6818f3464d67ac88d0437368dd05)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:55.540036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22a311-4507-434b-9f67-c11258188af1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:55.543779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 62/119] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:55 2022] GET /identity/v3/users/9d6b6818f3464d67ac88d0437368dd05 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:55.546063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457cebc-2bf7-4f55-8a64-bee8ab8f65f5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.546914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457cebc-2bf7-4f55-8a64-bee8ab8f65f5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.547570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457cebc-2bf7-4f55-8a64-bee8ab8f65f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.575580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e457cebc-2bf7-4f55-8a64-bee8ab8f65f5 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:55.576422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bbf09-bb05-4127-aa1c-6aa55bd9e29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:55.577273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bbf09-bb05-4127-aa1c-6aa55bd9e29e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.577561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bbf09-bb05-4127-aa1c-6aa55bd9e29e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.577893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bbf09-bb05-4127-aa1c-6aa55bd9e29e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.579351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e457cebc-2bf7-4f55-8a64-bee8ab8f65f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:55.592022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bbf09-bb05-4127-aa1c-6aa55bd9e29e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-765bbf09-bb05-4127-aa1c-6aa55bd9e29e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:55.607777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:55.609319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:42:55.610759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:55.615339 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 58/120] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:55.617177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bbf09-bb05-4127-aa1c-6aa55bd9e29e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:55.622181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:55.659863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:55.674693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 63/121] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:55.679989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457cebc-2bf7-4f55-8a64-bee8ab8f65f5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:55.799743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bbf09-bb05-4127-aa1c-6aa55bd9e29e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:55.806495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457cebc-2bf7-4f55-8a64-bee8ab8f65f5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:55.838116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99bfb6-1b8a-4870-a0d9-feb12dca9a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:55.839084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99bfb6-1b8a-4870-a0d9-feb12dca9a8a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.839377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99bfb6-1b8a-4870-a0d9-feb12dca9a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.839666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99bfb6-1b8a-4870-a0d9-feb12dca9a8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.845575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e47f3-b40b-4bba-a346-6ca85e57463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:55.846806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e47f3-b40b-4bba-a346-6ca85e57463d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:55.847294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e47f3-b40b-4bba-a346-6ca85e57463d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:55.847772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e47f3-b40b-4bba-a346-6ca85e57463d None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:55.849780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e47f3-b40b-4bba-a346-6ca85e57463d None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:55.852121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e47f3-b40b-4bba-a346-6ca85e57463d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:55.852233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99bfb6-1b8a-4870-a0d9-feb12dca9a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:55.854942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 64/122] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:55 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:55.856034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e47f3-b40b-4bba-a346-6ca85e57463d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ac99bfb6-1b8a-4870-a0d9-feb12dca9a8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:55.867138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:55.868377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:42:55.869203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:55.871714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 59/123] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:42:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:55.873554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99bfb6-1b8a-4870-a0d9-feb12dca9a8a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:55.945533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:55.970979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:56.011280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e47f3-b40b-4bba-a346-6ca85e57463d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:56.042634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99bfb6-1b8a-4870-a0d9-feb12dca9a8a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:56.069661 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8120f7-531b-47d7-a4e6-d6c91112f429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:56.070500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8120f7-531b-47d7-a4e6-d6c91112f429 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:56.070925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8120f7-531b-47d7-a4e6-d6c91112f429 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:56.071293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8120f7-531b-47d7-a4e6-d6c91112f429 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:56.072369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8120f7-531b-47d7-a4e6-d6c91112f429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:56.073732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8120f7-531b-47d7-a4e6-d6c91112f429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:56.076022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8120f7-531b-47d7-a4e6-d6c91112f429 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:56.090951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 65/124] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:56.091890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8120f7-531b-47d7-a4e6-d6c91112f429 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:56.092746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca1385-8aea-4cab-bd4c-b35c5d2a60c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:56.093850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca1385-8aea-4cab-bd4c-b35c5d2a60c1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:56.094457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca1385-8aea-4cab-bd4c-b35c5d2a60c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:56.095179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca1385-8aea-4cab-bd4c-b35c5d2a60c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:56.111306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca1385-8aea-4cab-bd4c-b35c5d2a60c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5fca1385-8aea-4cab-bd4c-b35c5d2a60c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:56.123346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:56.124285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:56.125049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:56.127416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 60/125] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:56.129044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca1385-8aea-4cab-bd4c-b35c5d2a60c1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:56.255882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8120f7-531b-47d7-a4e6-d6c91112f429 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:56.285381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:56.291565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca1385-8aea-4cab-bd4c-b35c5d2a60c1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:56.313847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af208bb-93e0-464b-b827-e0e788e5ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:56.315147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af208bb-93e0-464b-b827-e0e788e5ea64 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:56.315438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af208bb-93e0-464b-b827-e0e788e5ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:56.315722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af208bb-93e0-464b-b827-e0e788e5ea64 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae/users/9d6b6818f3464d67ac88d0437368dd05/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:56.318507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af208bb-93e0-464b-b827-e0e788e5ea64 None admin] RBAC: Authorizing `identity:create_grant(project_id=255f1d6d50524cb9927e19bc3f010eae, user_id=9d6b6818f3464d67ac88d0437368dd05, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:56.320405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af208bb-93e0-464b-b827-e0e788e5ea64 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:56.324744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:56.339950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 66/126] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:42:56 2022] PUT /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae/users/9d6b6818f3464d67ac88d0437368dd05/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:42:56.340606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c622ea4-6666-4585-9566-0cffa5b22bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:56.341393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c622ea4-6666-4585-9566-0cffa5b22bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:56.341684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c622ea4-6666-4585-9566-0cffa5b22bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:56.341965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c622ea4-6666-4585-9566-0cffa5b22bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:56.342463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af208bb-93e0-464b-b827-e0e788e5ea64 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:56.342896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c622ea4-6666-4585-9566-0cffa5b22bb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:56.343271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c622ea4-6666-4585-9566-0cffa5b22bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:56.345071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c622ea4-6666-4585-9566-0cffa5b22bb8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:56.358910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 61/127] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:42:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:56.365653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c622ea4-6666-4585-9566-0cffa5b22bb8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:56.495687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c622ea4-6666-4585-9566-0cffa5b22bb8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:56.536284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010efea-176e-4b00-8c27-62d21ecafcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:56.537700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010efea-176e-4b00-8c27-62d21ecafcbd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:56.538506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010efea-176e-4b00-8c27-62d21ecafcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:56.539022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010efea-176e-4b00-8c27-62d21ecafcbd None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:56.540036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010efea-176e-4b00-8c27-62d21ecafcbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:56.540617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010efea-176e-4b00-8c27-62d21ecafcbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:56.542449 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010efea-176e-4b00-8c27-62d21ecafcbd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:56.550505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af208bb-93e0-464b-b827-e0e788e5ea64 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:56.554877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 62/128] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:42:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:56.556407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010efea-176e-4b00-8c27-62d21ecafcbd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:56.611230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:56.614573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2ea1f-3b7a-4cce-bc41-0413dfe2ce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:56.616559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ea1f-3b7a-4cce-bc41-0413dfe2ce8e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:56.617643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ea1f-3b7a-4cce-bc41-0413dfe2ce8e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:56.618073 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ea1f-3b7a-4cce-bc41-0413dfe2ce8e None admin] PATH_INFO: `/v3/users/037e9f95a2ad44f08247184b10274c13` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:56.619671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ea1f-3b7a-4cce-bc41-0413dfe2ce8e None admin] RBAC: Authorizing `identity:get_user(user_id=037e9f95a2ad44f08247184b10274c13)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:56.622054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ea1f-3b7a-4cce-bc41-0413dfe2ce8e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:56.624306 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 67/129] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:56 2022] GET /identity/v3/users/037e9f95a2ad44f08247184b10274c13 => generated 247 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:56.625281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2ea1f-3b7a-4cce-bc41-0413dfe2ce8e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:56.684493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010efea-176e-4b00-8c27-62d21ecafcbd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:56.696616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:56.727983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1b50a-dc8a-4d3b-8da9-2d7accd7455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:56.729435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1b50a-dc8a-4d3b-8da9-2d7accd7455b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:56.730496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1b50a-dc8a-4d3b-8da9-2d7accd7455b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:56.730776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1b50a-dc8a-4d3b-8da9-2d7accd7455b None admin] PATH_INFO: `/v3/users/9d6b6818f3464d67ac88d0437368dd05` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:56.734916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1b50a-dc8a-4d3b-8da9-2d7accd7455b None admin] RBAC: Authorizing `identity:get_user(user_id=9d6b6818f3464d67ac88d0437368dd05)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:56.737603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1b50a-dc8a-4d3b-8da9-2d7accd7455b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:56.739991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 63/130] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:56 2022] GET /identity/v3/users/9d6b6818f3464d67ac88d0437368dd05 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:56.741091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1b50a-dc8a-4d3b-8da9-2d7accd7455b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:56.791682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2ea1f-3b7a-4cce-bc41-0413dfe2ce8e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:56.841964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b3827-1116-4956-8b8b-5efbe9804699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:56.843390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b3827-1116-4956-8b8b-5efbe9804699 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:56.843876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b3827-1116-4956-8b8b-5efbe9804699 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:56.844350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b3827-1116-4956-8b8b-5efbe9804699 None admin] PATH_INFO: `/v3/users/9d6b6818f3464d67ac88d0437368dd05` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:56.845820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b3827-1116-4956-8b8b-5efbe9804699 None admin] RBAC: Authorizing `identity:get_user(user_id=9d6b6818f3464d67ac88d0437368dd05)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:56.847736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b3827-1116-4956-8b8b-5efbe9804699 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:56.849842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 68/131] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:56 2022] GET /identity/v3/users/9d6b6818f3464d67ac88d0437368dd05 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:56.851141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b3827-1116-4956-8b8b-5efbe9804699 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:56.970598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b3827-1116-4956-8b8b-5efbe9804699 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:57.000388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1b50a-dc8a-4d3b-8da9-2d7accd7455b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:57.001147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:57.018551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a228e-36f5-42a0-a9cc-1be9940568f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:57.020221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:57.022004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a228e-36f5-42a0-a9cc-1be9940568f5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.022546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a228e-36f5-42a0-a9cc-1be9940568f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.023023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a228e-36f5-42a0-a9cc-1be9940568f5 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.026771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a228e-36f5-42a0-a9cc-1be9940568f5 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:57.028837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a228e-36f5-42a0-a9cc-1be9940568f5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:57.031087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 69/132] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:56 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:57.032093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a228e-36f5-42a0-a9cc-1be9940568f5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:57.041830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840c87c-804c-466a-9a4e-fa3910b558b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:57.042634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840c87c-804c-466a-9a4e-fa3910b558b6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.042928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840c87c-804c-466a-9a4e-fa3910b558b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.043210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840c87c-804c-466a-9a4e-fa3910b558b6 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.044456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840c87c-804c-466a-9a4e-fa3910b558b6 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:57.045950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840c87c-804c-466a-9a4e-fa3910b558b6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:57.054113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 64/133] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:56 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:57.054113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840c87c-804c-466a-9a4e-fa3910b558b6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:57.165558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840c87c-804c-466a-9a4e-fa3910b558b6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:57.204104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f5bb0-2258-4f05-be47-b17786968ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:57.205086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f5bb0-2258-4f05-be47-b17786968ae1 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.205420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f5bb0-2258-4f05-be47-b17786968ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.205702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f5bb0-2258-4f05-be47-b17786968ae1 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae/users/9d6b6818f3464d67ac88d0437368dd05/roles/1a772cde30724b09b110b5dffecfd462` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.208738 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f5bb0-2258-4f05-be47-b17786968ae1 None admin] RBAC: Authorizing `identity:create_grant(project_id=255f1d6d50524cb9927e19bc3f010eae, user_id=9d6b6818f3464d67ac88d0437368dd05, role_id=1a772cde30724b09b110b5dffecfd462)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:57.212491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f5bb0-2258-4f05-be47-b17786968ae1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:57.242133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 65/134] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:42:57 2022] PUT /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae/users/9d6b6818f3464d67ac88d0437368dd05/roles/1a772cde30724b09b110b5dffecfd462 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:42:57.243041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f5bb0-2258-4f05-be47-b17786968ae1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:57.244277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a228e-36f5-42a0-a9cc-1be9940568f5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:57.362140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad5f37-0bc2-44a7-ad0b-64401e253eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:57.367329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:57.370163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad5f37-0bc2-44a7-ad0b-64401e253eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.370976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad5f37-0bc2-44a7-ad0b-64401e253eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.371398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad5f37-0bc2-44a7-ad0b-64401e253eb3 None admin] PATH_INFO: `/v3/projects/d2a921eabd6648f487d0ed2607e6ec16` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.373775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad5f37-0bc2-44a7-ad0b-64401e253eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a921eabd6648f487d0ed2607e6ec16)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:57.379190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad5f37-0bc2-44a7-ad0b-64401e253eb3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:57.381738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 70/135] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:57 2022] GET /identity/v3/projects/d2a921eabd6648f487d0ed2607e6ec16 => generated 312 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:57.393330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb3d06-7235-4807-a7cb-51f21e9d6ee6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.393330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb3d06-7235-4807-a7cb-51f21e9d6ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.393330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb3d06-7235-4807-a7cb-51f21e9d6ee6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.393330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 71/136] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:57.393330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb3d06-7235-4807-a7cb-51f21e9d6ee6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:57.524489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb3d06-7235-4807-a7cb-51f21e9d6ee6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:57.534557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:57.551565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f5bb0-2258-4f05-be47-b17786968ae1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:57.577420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd5503-b4df-4989-be67-7f8f18be94b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:57.578687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd5503-b4df-4989-be67-7f8f18be94b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.579165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd5503-b4df-4989-be67-7f8f18be94b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.579604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd5503-b4df-4989-be67-7f8f18be94b9 None admin] PATH_INFO: `/v3/projects/d2a921eabd6648f487d0ed2607e6ec16/users/9d6b6818f3464d67ac88d0437368dd05/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.582549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd5503-b4df-4989-be67-7f8f18be94b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2a921eabd6648f487d0ed2607e6ec16, user_id=9d6b6818f3464d67ac88d0437368dd05, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:57.584806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd5503-b4df-4989-be67-7f8f18be94b9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:57.597971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc31028-eb53-48c9-a85f-62bd008e012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:57.599172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc31028-eb53-48c9-a85f-62bd008e012b None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.599968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc31028-eb53-48c9-a85f-62bd008e012b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.599968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc31028-eb53-48c9-a85f-62bd008e012b None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae/users/037e9f95a2ad44f08247184b10274c13/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.602126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc31028-eb53-48c9-a85f-62bd008e012b None admin] RBAC: Authorizing `identity:create_grant(project_id=255f1d6d50524cb9927e19bc3f010eae, user_id=037e9f95a2ad44f08247184b10274c13, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:57.603678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc31028-eb53-48c9-a85f-62bd008e012b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:57.606252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 72/137] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:42:57 2022] PUT /identity/v3/projects/d2a921eabd6648f487d0ed2607e6ec16/users/9d6b6818f3464d67ac88d0437368dd05/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:42:57.608456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335bff9-ac6b-4baa-9105-58f65dbb6f44 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.608837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335bff9-ac6b-4baa-9105-58f65dbb6f44 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.609185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335bff9-ac6b-4baa-9105-58f65dbb6f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.621550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 66/138] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:42:57 2022] PUT /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae/users/037e9f95a2ad44f08247184b10274c13/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:42:57.623394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac4734-bfac-48e8-ac9a-70a99f6bbba0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.623786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac4734-bfac-48e8-ac9a-70a99f6bbba0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.624190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac4734-bfac-48e8-ac9a-70a99f6bbba0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.626173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 67/139] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:57.630790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7335bff9-ac6b-4baa-9105-58f65dbb6f44 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:57.632202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7335bff9-ac6b-4baa-9105-58f65dbb6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:57.633003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da464-4290-4382-9a94-ce794adcbab5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.633307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da464-4290-4382-9a94-ce794adcbab5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.633727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da464-4290-4382-9a94-ce794adcbab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.655054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d96da464-4290-4382-9a94-ce794adcbab5 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:57.656266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d96da464-4290-4382-9a94-ce794adcbab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:57.711151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 73/140] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:57.743982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 68/141] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:42:57.759031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335bff9-ac6b-4baa-9105-58f65dbb6f44 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:57.768263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96da464-4290-4382-9a94-ce794adcbab5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:57.805356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:57.826716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:57.881561 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335bff9-ac6b-4baa-9105-58f65dbb6f44 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:57.896360 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96da464-4290-4382-9a94-ce794adcbab5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:57.925226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff558ac-f1f7-40e8-93ce-05f7136780cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:57.926109 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff558ac-f1f7-40e8-93ce-05f7136780cd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.926525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff558ac-f1f7-40e8-93ce-05f7136780cd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.926815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff558ac-f1f7-40e8-93ce-05f7136780cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.928462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff558ac-f1f7-40e8-93ce-05f7136780cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:57.931296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff558ac-f1f7-40e8-93ce-05f7136780cd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:57.936092 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 74/142] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:42:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:57.939548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415e479-c5be-4eb8-a013-bb9cd7910944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:57.939890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff558ac-f1f7-40e8-93ce-05f7136780cd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:57.940531 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415e479-c5be-4eb8-a013-bb9cd7910944 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:57.940824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415e479-c5be-4eb8-a013-bb9cd7910944 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:57.941113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415e479-c5be-4eb8-a013-bb9cd7910944 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:57.956728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415e479-c5be-4eb8-a013-bb9cd7910944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d415e479-c5be-4eb8-a013-bb9cd7910944 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:57.967494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:57.969684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:57.971072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 69/143] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:42:57.975805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415e479-c5be-4eb8-a013-bb9cd7910944 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:58.133090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff558ac-f1f7-40e8-93ce-05f7136780cd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:58.145231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:58.170309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:58.179861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d20f0-f66d-4470-8cf3-445188aad6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:58.180605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d20f0-f66d-4470-8cf3-445188aad6d5 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:58.180975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d20f0-f66d-4470-8cf3-445188aad6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:58.181254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d20f0-f66d-4470-8cf3-445188aad6d5 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:58.182007 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d20f0-f66d-4470-8cf3-445188aad6d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:58.183554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d20f0-f66d-4470-8cf3-445188aad6d5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:58.190834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415e479-c5be-4eb8-a013-bb9cd7910944 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:58.246790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 75/144] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:42:57 2022] POST /identity/v3/users => generated 283 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:42:58.268374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd099-93e0-4543-99fa-f6dd46724aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:58.269069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd099-93e0-4543-99fa-f6dd46724aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:58.269354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd099-93e0-4543-99fa-f6dd46724aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:58.269681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd099-93e0-4543-99fa-f6dd46724aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:58.270578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefd099-93e0-4543-99fa-f6dd46724aa3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:58.270895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefd099-93e0-4543-99fa-f6dd46724aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:58.275225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefd099-93e0-4543-99fa-f6dd46724aa3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:58.293222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 70/145] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:42:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:58.298883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d20f0-f66d-4470-8cf3-445188aad6d5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:58.465348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d20f0-f66d-4470-8cf3-445188aad6d5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:58.515480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06408b0f-a7d9-4070-853b-6ed14de24b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:58.516424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06408b0f-a7d9-4070-853b-6ed14de24b59 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:58.516707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06408b0f-a7d9-4070-853b-6ed14de24b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:58.516981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06408b0f-a7d9-4070-853b-6ed14de24b59 None admin] PATH_INFO: `/v3/users/b0a11d8c08574daab9ad9ae8d88a93e5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:58.518345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06408b0f-a7d9-4070-853b-6ed14de24b59 None admin] RBAC: Authorizing `identity:get_user(user_id=b0a11d8c08574daab9ad9ae8d88a93e5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:58.519877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06408b0f-a7d9-4070-853b-6ed14de24b59 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:58.521751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 76/146] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:58 2022] GET /identity/v3/users/b0a11d8c08574daab9ad9ae8d88a93e5 => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:42:58.527489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd099-93e0-4543-99fa-f6dd46724aa3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:58.659974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd099-93e0-4543-99fa-f6dd46724aa3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:58.698043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05158a2f-bcac-4b86-9090-e68d695b6900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:58.699146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05158a2f-bcac-4b86-9090-e68d695b6900 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:58.699440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05158a2f-bcac-4b86-9090-e68d695b6900 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:58.699723 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05158a2f-bcac-4b86-9090-e68d695b6900 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:58.701382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05158a2f-bcac-4b86-9090-e68d695b6900 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:58.702975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05158a2f-bcac-4b86-9090-e68d695b6900 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:58.705127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 71/147] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:42:58 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:58.715262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06408b0f-a7d9-4070-853b-6ed14de24b59 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:58.782896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:58.884503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06408b0f-a7d9-4070-853b-6ed14de24b59 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:58.928555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516ac9-7f35-4ee3-8ede-9f70aec3dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:58.929504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516ac9-7f35-4ee3-8ede-9f70aec3dc0c None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:58.929784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516ac9-7f35-4ee3-8ede-9f70aec3dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:58.930057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516ac9-7f35-4ee3-8ede-9f70aec3dc0c None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae/users/b0a11d8c08574daab9ad9ae8d88a93e5/roles/443ff5b7485a44109a9411b445079892` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:58.932331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516ac9-7f35-4ee3-8ede-9f70aec3dc0c None admin] RBAC: Authorizing `identity:create_grant(project_id=255f1d6d50524cb9927e19bc3f010eae, user_id=b0a11d8c08574daab9ad9ae8d88a93e5, role_id=443ff5b7485a44109a9411b445079892)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:58.933877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516ac9-7f35-4ee3-8ede-9f70aec3dc0c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:58.962764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 77/148] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:42:58 2022] PUT /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae/users/b0a11d8c08574daab9ad9ae8d88a93e5/roles/443ff5b7485a44109a9411b445079892 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:42:59.375981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600c4bc-ddc1-4238-9c38-78489bfcf21d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:59.376316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600c4bc-ddc1-4238-9c38-78489bfcf21d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:59.376555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600c4bc-ddc1-4238-9c38-78489bfcf21d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:59.378210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 72/149] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:42:59.387902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188107f8-75ca-44f7-831d-27f4d62b234a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:59.388975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188107f8-75ca-44f7-831d-27f4d62b234a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:59.389473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188107f8-75ca-44f7-831d-27f4d62b234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:59.408878 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-188107f8-75ca-44f7-831d-27f4d62b234a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:42:59.410576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-188107f8-75ca-44f7-831d-27f4d62b234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:42:59.497472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 78/150] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:42:59.522757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600c4bc-ddc1-4238-9c38-78489bfcf21d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:59.551700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:59.654788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600c4bc-ddc1-4238-9c38-78489bfcf21d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:59.701647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba2f40-1543-4d78-ac70-ef58d9b4943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:59.702520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba2f40-1543-4d78-ac70-ef58d9b4943c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:59.702810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba2f40-1543-4d78-ac70-ef58d9b4943c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:59.703091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba2f40-1543-4d78-ac70-ef58d9b4943c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:59.714369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba2f40-1543-4d78-ac70-ef58d9b4943c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f7ba2f40-1543-4d78-ac70-ef58d9b4943c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:42:59.726988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:42:59.727959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:42:59.729167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 73/151] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:42:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:42:59.736060 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188107f8-75ca-44f7-831d-27f4d62b234a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:42:59.780640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:42:59.891141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188107f8-75ca-44f7-831d-27f4d62b234a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:42:59.936391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886f696-d99a-47a8-8e2e-28e5808b2384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:42:59.937009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886f696-d99a-47a8-8e2e-28e5808b2384 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:42:59.937290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886f696-d99a-47a8-8e2e-28e5808b2384 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:42:59.937559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886f696-d99a-47a8-8e2e-28e5808b2384 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:42:59.938355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886f696-d99a-47a8-8e2e-28e5808b2384 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:42:59.938664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886f696-d99a-47a8-8e2e-28e5808b2384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:42:59.940116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886f696-d99a-47a8-8e2e-28e5808b2384 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:42:59.954451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 79/152] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:42:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:42:59.960890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba2f40-1543-4d78-ac70-ef58d9b4943c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:00.073181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:00.096039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba2f40-1543-4d78-ac70-ef58d9b4943c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:00.134577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e986f-7f4c-45a8-ae3d-bf633a81c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:00.135506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e986f-7f4c-45a8-ae3d-bf633a81c471 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:00.135794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e986f-7f4c-45a8-ae3d-bf633a81c471 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:00.136073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e986f-7f4c-45a8-ae3d-bf633a81c471 None admin] PATH_INFO: `/v3/users/9d6b6818f3464d67ac88d0437368dd05` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:00.137336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e986f-7f4c-45a8-ae3d-bf633a81c471 None admin] RBAC: Authorizing `identity:get_user(user_id=9d6b6818f3464d67ac88d0437368dd05)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:00.138864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e986f-7f4c-45a8-ae3d-bf633a81c471 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:00.140853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 74/153] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:42:59 2022] GET /identity/v3/users/9d6b6818f3464d67ac88d0437368dd05 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:00.146588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886f696-d99a-47a8-8e2e-28e5808b2384 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:00.243451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:00.256022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886f696-d99a-47a8-8e2e-28e5808b2384 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:00.291725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951e133-a203-4e31-b378-1feda5a16f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:00.292411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951e133-a203-4e31-b378-1feda5a16f0e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:00.292699 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951e133-a203-4e31-b378-1feda5a16f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:00.292979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951e133-a203-4e31-b378-1feda5a16f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:00.365159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951e133-a203-4e31-b378-1feda5a16f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:00.366786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951e133-a203-4e31-b378-1feda5a16f0e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:00.458493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:00.475212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 80/154] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 12:43:00.481617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e986f-7f4c-45a8-ae3d-bf633a81c471 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:00.623419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e986f-7f4c-45a8-ae3d-bf633a81c471 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:00.663986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6954c-5210-49a2-bf5e-f667e1e24ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:00.664903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6954c-5210-49a2-bf5e-f667e1e24ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:00.665191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6954c-5210-49a2-bf5e-f667e1e24ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:00.665528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6954c-5210-49a2-bf5e-f667e1e24ec8 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:00.666866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6954c-5210-49a2-bf5e-f667e1e24ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:00.669020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6954c-5210-49a2-bf5e-f667e1e24ec8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:00.671143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 75/155] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:00 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:00.677188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951e133-a203-4e31-b378-1feda5a16f0e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:00.786499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951e133-a203-4e31-b378-1feda5a16f0e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:00.823804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60254b5d-d0e0-43ef-b860-8b9be7a70414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:00.824489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60254b5d-d0e0-43ef-b860-8b9be7a70414 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:00.824778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60254b5d-d0e0-43ef-b860-8b9be7a70414 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:00.825058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60254b5d-d0e0-43ef-b860-8b9be7a70414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:00.825965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60254b5d-d0e0-43ef-b860-8b9be7a70414 None admin] RBAC: Adding query filter params (role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=255f1d6d50524cb9927e19bc3f010eae, user.id=9d6b6818f3464d67ac88d0437368dd05) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:00.826318 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60254b5d-d0e0-43ef-b860-8b9be7a70414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:00.827964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60254b5d-d0e0-43ef-b860-8b9be7a70414 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:00.835064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 81/156] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:00 2022] GET /identity/v3/role_assignments?user.id=9d6b6818f3464d67ac88d0437368dd05&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=3d852826ac0a4f09b618a220333f2897 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:01.275408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7e740-6f63-41e9-a467-03edc0109eb1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:01.275822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7e740-6f63-41e9-a467-03edc0109eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:01.276111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7e740-6f63-41e9-a467-03edc0109eb1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:01.277768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 76/157] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:01.283692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94639-9351-4746-af55-337bae1178cc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:01.283997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94639-9351-4746-af55-337bae1178cc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:01.284412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a94639-9351-4746-af55-337bae1178cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:01.308481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-66a94639-9351-4746-af55-337bae1178cc None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:01.309753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-66a94639-9351-4746-af55-337bae1178cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:01.391162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:01.419592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c08a-ccd4-4148-845e-d90a535b7e57 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:01.419910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c08a-ccd4-4148-845e-d90a535b7e57 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:01.420153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c08a-ccd4-4148-845e-d90a535b7e57 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:01.421707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 77/158] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:01.432088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 82/159] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:01.435075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc76d32-cd7d-46f9-8ca8-b0ca40ac694b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:01.435563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc76d32-cd7d-46f9-8ca8-b0ca40ac694b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:01.435996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc76d32-cd7d-46f9-8ca8-b0ca40ac694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:01.457460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1bc76d32-cd7d-46f9-8ca8-b0ca40ac694b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:01.458754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1bc76d32-cd7d-46f9-8ca8-b0ca40ac694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:01.469613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94639-9351-4746-af55-337bae1178cc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:01.498503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:01.633067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a94639-9351-4746-af55-337bae1178cc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:01.675396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60da2e7-c312-4883-a03e-9fd4b0b46895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:01.677800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 78/160] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:01.679451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60da2e7-c312-4883-a03e-9fd4b0b46895 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:01.679886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60da2e7-c312-4883-a03e-9fd4b0b46895 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:01.680313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60da2e7-c312-4883-a03e-9fd4b0b46895 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:01.692600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60da2e7-c312-4883-a03e-9fd4b0b46895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d60da2e7-c312-4883-a03e-9fd4b0b46895 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:01.702526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:01.703600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:01.704569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:01.706852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 83/161] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:01.715930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc76d32-cd7d-46f9-8ca8-b0ca40ac694b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:01.739658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60da2e7-c312-4883-a03e-9fd4b0b46895 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:01.854506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:01.874282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc76d32-cd7d-46f9-8ca8-b0ca40ac694b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:01.917004 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be1ca6-f0f4-462c-b816-041eb75c8c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:01.917954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be1ca6-f0f4-462c-b816-041eb75c8c6b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:01.918565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be1ca6-f0f4-462c-b816-041eb75c8c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:01.919007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be1ca6-f0f4-462c-b816-041eb75c8c6b None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:01.920096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be1ca6-f0f4-462c-b816-041eb75c8c6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:01.920563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be1ca6-f0f4-462c-b816-041eb75c8c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:01.922149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be1ca6-f0f4-462c-b816-041eb75c8c6b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:01.932428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 79/162] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:01.938252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be1ca6-f0f4-462c-b816-041eb75c8c6b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:01.972523 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:02.014286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60da2e7-c312-4883-a03e-9fd4b0b46895 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:02.092867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f211e-b6fa-4044-ad38-c92a2453bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:02.094437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f211e-b6fa-4044-ad38-c92a2453bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:02.094887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f211e-b6fa-4044-ad38-c92a2453bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:02.095307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f211e-b6fa-4044-ad38-c92a2453bcf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:02.121157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f211e-b6fa-4044-ad38-c92a2453bcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d80f211e-b6fa-4044-ad38-c92a2453bcf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:02.130738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:02.132003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:02.132998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:02.140344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 84/163] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:02.143259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0c6f-acf6-41fe-b6af-d5c380af1dbc None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:02.143947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0c6f-acf6-41fe-b6af-d5c380af1dbc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:02.144387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0c6f-acf6-41fe-b6af-d5c380af1dbc None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:02.151005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 85/164] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:02.152392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba0c6f-acf6-41fe-b6af-d5c380af1dbc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:02.236995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be1ca6-f0f4-462c-b816-041eb75c8c6b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:02.304719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efca660-0993-4f1b-85e1-11daf340cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:02.305662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efca660-0993-4f1b-85e1-11daf340cf38 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:02.305942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efca660-0993-4f1b-85e1-11daf340cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:02.306252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efca660-0993-4f1b-85e1-11daf340cf38 None admin] PATH_INFO: `/v3/users/9d6b6818f3464d67ac88d0437368dd05` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:02.307756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efca660-0993-4f1b-85e1-11daf340cf38 None admin] RBAC: Authorizing `identity:get_user(user_id=9d6b6818f3464d67ac88d0437368dd05)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:02.309273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efca660-0993-4f1b-85e1-11daf340cf38 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:02.314176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 80/165] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:01 2022] GET /identity/v3/users/9d6b6818f3464d67ac88d0437368dd05 => generated 275 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:02.314176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0720312-7c0d-4186-9ced-07b88d68e507 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:02.314176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0720312-7c0d-4186-9ced-07b88d68e507 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:02.314176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0720312-7c0d-4186-9ced-07b88d68e507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:02.351858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f0720312-7c0d-4186-9ced-07b88d68e507 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:02.353772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f0720312-7c0d-4186-9ced-07b88d68e507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:02.434867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:02.452834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba0c6f-acf6-41fe-b6af-d5c380af1dbc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:02.521875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 81/166] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:02.522563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0720312-7c0d-4186-9ced-07b88d68e507 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:02.548747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c247a-d23b-4a0b-83d9-f649a325a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:02.549509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c247a-d23b-4a0b-83d9-f649a325a8fe None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:02.549788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c247a-d23b-4a0b-83d9-f649a325a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:02.550136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c247a-d23b-4a0b-83d9-f649a325a8fe None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:02.550385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:02.551247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c247a-d23b-4a0b-83d9-f649a325a8fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:02.552111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c247a-d23b-4a0b-83d9-f649a325a8fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:02.555476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c247a-d23b-4a0b-83d9-f649a325a8fe None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:02.581232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 86/167] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:02.584339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c247a-d23b-4a0b-83d9-f649a325a8fe None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:02.769368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0720312-7c0d-4186-9ced-07b88d68e507 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:02.828350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c247a-d23b-4a0b-83d9-f649a325a8fe None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:02.856562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed66b2f-8741-4476-998e-f317c6862040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:02.857251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed66b2f-8741-4476-998e-f317c6862040 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:02.857537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed66b2f-8741-4476-998e-f317c6862040 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:02.857813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed66b2f-8741-4476-998e-f317c6862040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:02.905587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1e971-ceb8-4470-ae89-96ce1d1f582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:02.906455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e971-ceb8-4470-ae89-96ce1d1f582a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:02.906740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e971-ceb8-4470-ae89-96ce1d1f582a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:02.907016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e971-ceb8-4470-ae89-96ce1d1f582a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:02.928418 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1e971-ceb8-4470-ae89-96ce1d1f582a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0ed1e971-ceb8-4470-ae89-96ce1d1f582a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:02.943918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:02.944960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:02.945734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 87/168] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:02.946419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1e971-ceb8-4470-ae89-96ce1d1f582a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:02.990552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:03.002058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed66b2f-8741-4476-998e-f317c6862040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:03.004297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed66b2f-8741-4476-998e-f317c6862040 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:03.026530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:03.144064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1e971-ceb8-4470-ae89-96ce1d1f582a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:03.204916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 82/169] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:03.205817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed66b2f-8741-4476-998e-f317c6862040 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:03.220873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d29651-01a3-4537-ba78-a926184428a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:03.221803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d29651-01a3-4537-ba78-a926184428a2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.222188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d29651-01a3-4537-ba78-a926184428a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.222373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d29651-01a3-4537-ba78-a926184428a2 None admin] PATH_INFO: `/v3/users/9d6b6818f3464d67ac88d0437368dd05` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.225743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d29651-01a3-4537-ba78-a926184428a2 None admin] RBAC: Authorizing `identity:get_user(user_id=9d6b6818f3464d67ac88d0437368dd05)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:03.227334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d29651-01a3-4537-ba78-a926184428a2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:03.229061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 88/170] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:02 2022] GET /identity/v3/users/9d6b6818f3464d67ac88d0437368dd05 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:03.230668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546454f1-6a60-4802-827d-d1d7623ddb19 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.230949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546454f1-6a60-4802-827d-d1d7623ddb19 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.231227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546454f1-6a60-4802-827d-d1d7623ddb19 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.232623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 89/171] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:03.233168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546454f1-6a60-4802-827d-d1d7623ddb19 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:03.342810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:03.344494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed66b2f-8741-4476-998e-f317c6862040 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:03.353944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546454f1-6a60-4802-827d-d1d7623ddb19 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:03.383231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3578d2b-d9e5-42c2-b090-6bac775539c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:03.384521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3578d2b-d9e5-42c2-b090-6bac775539c9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.384944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3578d2b-d9e5-42c2-b090-6bac775539c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.385381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3578d2b-d9e5-42c2-b090-6bac775539c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.386338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3578d2b-d9e5-42c2-b090-6bac775539c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:03.386877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3578d2b-d9e5-42c2-b090-6bac775539c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:03.388566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3578d2b-d9e5-42c2-b090-6bac775539c9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:03.390422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:03.392936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25273e5-e756-4861-b119-e4bbed17690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:03.393843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25273e5-e756-4861-b119-e4bbed17690c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.394212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25273e5-e756-4861-b119-e4bbed17690c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.394463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25273e5-e756-4861-b119-e4bbed17690c None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.396236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25273e5-e756-4861-b119-e4bbed17690c None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:03.397740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25273e5-e756-4861-b119-e4bbed17690c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:03.404634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 90/172] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:03 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:03.404634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25273e5-e756-4861-b119-e4bbed17690c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:03.405578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 83/173] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:03.407215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed41bb-5b24-4d55-a4ff-9b4b32fd48bb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.407678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed41bb-5b24-4d55-a4ff-9b4b32fd48bb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.408127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed41bb-5b24-4d55-a4ff-9b4b32fd48bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.431501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dfed41bb-5b24-4d55-a4ff-9b4b32fd48bb None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:03.433087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dfed41bb-5b24-4d55-a4ff-9b4b32fd48bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:03.510781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 84/174] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:03.512622 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bea21-cd6c-4d28-bf05-41971c93b07b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.513113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bea21-cd6c-4d28-bf05-41971c93b07b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.513215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25273e5-e756-4861-b119-e4bbed17690c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:03.513695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bea21-cd6c-4d28-bf05-41971c93b07b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.515435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 85/175] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:03.516437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bea21-cd6c-4d28-bf05-41971c93b07b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:03.554760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9d958-809f-4852-9361-236571435142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:03.556246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9d958-809f-4852-9361-236571435142 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.556246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9d958-809f-4852-9361-236571435142 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.556246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9d958-809f-4852-9361-236571435142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.589071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:03.631761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:03.637897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bea21-cd6c-4d28-bf05-41971c93b07b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:03.638467 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9d958-809f-4852-9361-236571435142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:03.639996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9d958-809f-4852-9361-236571435142 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:03.673002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3d225-ee2a-4578-ad29-11845424781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:03.673814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3d225-ee2a-4578-ad29-11845424781d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.674118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3d225-ee2a-4578-ad29-11845424781d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.674390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3d225-ee2a-4578-ad29-11845424781d None admin] PATH_INFO: `/v3/users/037e9f95a2ad44f08247184b10274c13` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.675581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3d225-ee2a-4578-ad29-11845424781d None admin] RBAC: Authorizing `identity:get_user(user_id=037e9f95a2ad44f08247184b10274c13)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:03.677054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3d225-ee2a-4578-ad29-11845424781d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:03.679109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 86/176] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:03 2022] GET /identity/v3/users/037e9f95a2ad44f08247184b10274c13 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:03.679707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3d225-ee2a-4578-ad29-11845424781d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:03.748970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 91/177] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:03.751069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36703b6-800f-4cb9-8356-e2dc1ba389c8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.751531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36703b6-800f-4cb9-8356-e2dc1ba389c8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.751982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36703b6-800f-4cb9-8356-e2dc1ba389c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.771185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d36703b6-800f-4cb9-8356-e2dc1ba389c8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:03.772437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d36703b6-800f-4cb9-8356-e2dc1ba389c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:03.785150 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3d225-ee2a-4578-ad29-11845424781d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:03.821542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84cc9-a12a-4698-aeb2-1d67b37a5d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:03.822265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84cc9-a12a-4698-aeb2-1d67b37a5d42 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.822550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84cc9-a12a-4698-aeb2-1d67b37a5d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.822829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84cc9-a12a-4698-aeb2-1d67b37a5d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.823687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee84cc9-a12a-4698-aeb2-1d67b37a5d42 None admin] RBAC: Adding query filter params (role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=255f1d6d50524cb9927e19bc3f010eae, user.id=9d6b6818f3464d67ac88d0437368dd05) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:03.824002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee84cc9-a12a-4698-aeb2-1d67b37a5d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:03.825499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee84cc9-a12a-4698-aeb2-1d67b37a5d42 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:03.827015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:03.832322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 87/178] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:03 2022] GET /identity/v3/role_assignments?user.id=9d6b6818f3464d67ac88d0437368dd05&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=1a772cde30724b09b110b5dffecfd462 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:03.833156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84cc9-a12a-4698-aeb2-1d67b37a5d42 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:03.857417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 92/179] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:03.859365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6306e-9f95-4589-8038-766b73e37322 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.859655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6306e-9f95-4589-8038-766b73e37322 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.859918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6306e-9f95-4589-8038-766b73e37322 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.865886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 93/180] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:03.865886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bd51d-aa44-4a25-ad21-bcce8a3c2c11 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.865886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bd51d-aa44-4a25-ad21-bcce8a3c2c11 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.865886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bd51d-aa44-4a25-ad21-bcce8a3c2c11 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:03.865886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 94/181] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:03.866462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bd51d-aa44-4a25-ad21-bcce8a3c2c11 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:03.875974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:03.955532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84cc9-a12a-4698-aeb2-1d67b37a5d42 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:03.988219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bd51d-aa44-4a25-ad21-bcce8a3c2c11 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:03.997454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87092a2e-d6c0-46af-aa1f-acfeb0592cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:03.998329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87092a2e-d6c0-46af-aa1f-acfeb0592cec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:03.998610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87092a2e-d6c0-46af-aa1f-acfeb0592cec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:03.998884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87092a2e-d6c0-46af-aa1f-acfeb0592cec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.011320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87092a2e-d6c0-46af-aa1f-acfeb0592cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-87092a2e-d6c0-46af-aa1f-acfeb0592cec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:04.019696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:04.020792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:04.021717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 88/182] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:43:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:04.022496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87092a2e-d6c0-46af-aa1f-acfeb0592cec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:04.040895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0783ead-d2e7-46fc-8068-8426e0e37ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:04.040895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0783ead-d2e7-46fc-8068-8426e0e37ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.041366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0783ead-d2e7-46fc-8068-8426e0e37ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.041655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0783ead-d2e7-46fc-8068-8426e0e37ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.112455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:04.129461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0783ead-d2e7-46fc-8068-8426e0e37ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:04.131271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0783ead-d2e7-46fc-8068-8426e0e37ff6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:04.143581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:04.154482 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87092a2e-d6c0-46af-aa1f-acfeb0592cec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:04.192813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a2f60-8694-4f0f-a26e-1664c36d798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:04.194014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2f60-8694-4f0f-a26e-1664c36d798d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.194448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2f60-8694-4f0f-a26e-1664c36d798d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.194731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a2f60-8694-4f0f-a26e-1664c36d798d None admin] PATH_INFO: `/v3/projects/d2a921eabd6648f487d0ed2607e6ec16` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.195962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a2f60-8694-4f0f-a26e-1664c36d798d None admin] RBAC: Authorizing `identity:get_project(project_id=d2a921eabd6648f487d0ed2607e6ec16)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:04.197483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a2f60-8694-4f0f-a26e-1664c36d798d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:04.199282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 89/183] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:04 2022] GET /identity/v3/projects/d2a921eabd6648f487d0ed2607e6ec16 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:04.200553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d169ea6-333b-4853-8f2b-3c8eecc367d4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.200846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d169ea6-333b-4853-8f2b-3c8eecc367d4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.201125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d169ea6-333b-4853-8f2b-3c8eecc367d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.218761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1d169ea6-333b-4853-8f2b-3c8eecc367d4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:04.220684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d169ea6-333b-4853-8f2b-3c8eecc367d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:04.241756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 95/184] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:04.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114418ee-f17e-4806-8653-4e094a101ea4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.243393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114418ee-f17e-4806-8653-4e094a101ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.243664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114418ee-f17e-4806-8653-4e094a101ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.260550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-114418ee-f17e-4806-8653-4e094a101ea4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:04.261766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-114418ee-f17e-4806-8653-4e094a101ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:04.301759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 90/185] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:04.302931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d169ea6-333b-4853-8f2b-3c8eecc367d4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:04.344861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 96/186] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:04.345738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114418ee-f17e-4806-8653-4e094a101ea4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:04.380393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:04.428966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:04.441421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d169ea6-333b-4853-8f2b-3c8eecc367d4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:04.478648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114418ee-f17e-4806-8653-4e094a101ea4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:04.484127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d903e-8f5d-4c9a-a009-2a2639ee6455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:04.484982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d903e-8f5d-4c9a-a009-2a2639ee6455 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.485271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d903e-8f5d-4c9a-a009-2a2639ee6455 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.485552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d903e-8f5d-4c9a-a009-2a2639ee6455 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.498066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d903e-8f5d-4c9a-a009-2a2639ee6455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-520d903e-8f5d-4c9a-a009-2a2639ee6455 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:04.507203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:04.508136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:04.508911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 91/187] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:04.509638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d903e-8f5d-4c9a-a009-2a2639ee6455 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:04.517668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a62461-ba98-4597-93b9-57f17356b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:04.518424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a62461-ba98-4597-93b9-57f17356b7ed None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.518706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a62461-ba98-4597-93b9-57f17356b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.518976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a62461-ba98-4597-93b9-57f17356b7ed None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.519926 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a62461-ba98-4597-93b9-57f17356b7ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:04.520235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a62461-ba98-4597-93b9-57f17356b7ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:04.521999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a62461-ba98-4597-93b9-57f17356b7ed None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:04.532036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 97/188] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:04.532980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a62461-ba98-4597-93b9-57f17356b7ed None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:04.628962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:04.650900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a62461-ba98-4597-93b9-57f17356b7ed None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:04.652035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d903e-8f5d-4c9a-a009-2a2639ee6455 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:04.689249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c4e61-eb9e-47ec-91e0-9c1d3e1be0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:04.690203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c4e61-eb9e-47ec-91e0-9c1d3e1be0be None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.690491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c4e61-eb9e-47ec-91e0-9c1d3e1be0be None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.690771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c4e61-eb9e-47ec-91e0-9c1d3e1be0be None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.692113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c4e61-eb9e-47ec-91e0-9c1d3e1be0be None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:04.693990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7a2f1-ed31-469c-9386-d285e4a4aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:04.694490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c4e61-eb9e-47ec-91e0-9c1d3e1be0be None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:04.694702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7a2f1-ed31-469c-9386-d285e4a4aeea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.695016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7a2f1-ed31-469c-9386-d285e4a4aeea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.695370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7a2f1-ed31-469c-9386-d285e4a4aeea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.696222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7a2f1-ed31-469c-9386-d285e4a4aeea None admin] RBAC: Adding query filter params (role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=d2a921eabd6648f487d0ed2607e6ec16, user.id=9d6b6818f3464d67ac88d0437368dd05) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:04.696343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 98/189] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:04 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:04.696416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7a2f1-ed31-469c-9386-d285e4a4aeea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:04.697001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c4e61-eb9e-47ec-91e0-9c1d3e1be0be None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:04.697978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7a2f1-ed31-469c-9386-d285e4a4aeea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:04.709128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 92/190] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:04 2022] GET /identity/v3/role_assignments?user.id=9d6b6818f3464d67ac88d0437368dd05&scope.project.id=d2a921eabd6648f487d0ed2607e6ec16&role.id=3d852826ac0a4f09b618a220333f2897 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:04.709991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7a2f1-ed31-469c-9386-d285e4a4aeea None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:04.730881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:04.836956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c4e61-eb9e-47ec-91e0-9c1d3e1be0be None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:04.845364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7a2f1-ed31-469c-9386-d285e4a4aeea None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:04.891107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39982d-5e82-46e5-a27e-b7c670204770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:04.892058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39982d-5e82-46e5-a27e-b7c670204770 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.892351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39982d-5e82-46e5-a27e-b7c670204770 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.892657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39982d-5e82-46e5-a27e-b7c670204770 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.899058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bddd7b-b4a7-45bb-97b3-0c6f739c07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:04.900454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bddd7b-b4a7-45bb-97b3-0c6f739c07a4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:04.901025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bddd7b-b4a7-45bb-97b3-0c6f739c07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:04.901477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bddd7b-b4a7-45bb-97b3-0c6f739c07a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:04.903167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bddd7b-b4a7-45bb-97b3-0c6f739c07a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:04.905016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bddd7b-b4a7-45bb-97b3-0c6f739c07a4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:04.907155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 93/191] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:04.908222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bddd7b-b4a7-45bb-97b3-0c6f739c07a4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:04.910554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39982d-5e82-46e5-a27e-b7c670204770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-2e39982d-5e82-46e5-a27e-b7c670204770 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:04.920856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:04.921931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:04.922849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 99/192] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:04.923541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39982d-5e82-46e5-a27e-b7c670204770 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:04.943387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:05.034317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:05.055979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bddd7b-b4a7-45bb-97b3-0c6f739c07a4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:05.063478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39982d-5e82-46e5-a27e-b7c670204770 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:05.096239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070babff-0c02-46af-921f-53c74a594b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:05.096951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070babff-0c02-46af-921f-53c74a594b32 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:05.097240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070babff-0c02-46af-921f-53c74a594b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:05.097524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070babff-0c02-46af-921f-53c74a594b32 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:05.098382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070babff-0c02-46af-921f-53c74a594b32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:05.098697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070babff-0c02-46af-921f-53c74a594b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:05.100911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070babff-0c02-46af-921f-53c74a594b32 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:05.102210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4660b-167d-414d-ba9e-c21e6acba0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:05.103147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4660b-167d-414d-ba9e-c21e6acba0bc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:05.103428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4660b-167d-414d-ba9e-c21e6acba0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:05.103703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4660b-167d-414d-ba9e-c21e6acba0bc None admin] PATH_INFO: `/v3/users/6f6253a91a884428b640e38261d8352f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:05.110581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 94/193] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:05.111448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070babff-0c02-46af-921f-53c74a594b32 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:05.123236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4660b-167d-414d-ba9e-c21e6acba0bc None admin] RBAC: Authorizing `identity:get_user(user_id=6f6253a91a884428b640e38261d8352f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:05.124798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4660b-167d-414d-ba9e-c21e6acba0bc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:05.126659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 100/194] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:04 2022] GET /identity/v3/users/6f6253a91a884428b640e38261d8352f => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:05.127445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4660b-167d-414d-ba9e-c21e6acba0bc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:05.207272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:05.231825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070babff-0c02-46af-921f-53c74a594b32 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:05.246346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4660b-167d-414d-ba9e-c21e6acba0bc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:05.268899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd943e-3369-4f55-8618-50f7259e78c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:05.269577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd943e-3369-4f55-8618-50f7259e78c2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:05.269854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd943e-3369-4f55-8618-50f7259e78c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:05.270165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd943e-3369-4f55-8618-50f7259e78c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:05.270992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd943e-3369-4f55-8618-50f7259e78c2 None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=255f1d6d50524cb9927e19bc3f010eae, user.id=037e9f95a2ad44f08247184b10274c13) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:05.271428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd943e-3369-4f55-8618-50f7259e78c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:05.272940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd943e-3369-4f55-8618-50f7259e78c2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:05.280638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 95/195] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:05 2022] GET /identity/v3/role_assignments?user.id=037e9f95a2ad44f08247184b10274c13&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:05.281459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd943e-3369-4f55-8618-50f7259e78c2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:05.293195 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f5d36-ceee-413e-890e-e7f2cd7028e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:05.293810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f5d36-ceee-413e-890e-e7f2cd7028e0 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:05.294112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f5d36-ceee-413e-890e-e7f2cd7028e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:05.294407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f5d36-ceee-413e-890e-e7f2cd7028e0 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:05.295180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f5d36-ceee-413e-890e-e7f2cd7028e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:05.296767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f5d36-ceee-413e-890e-e7f2cd7028e0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:05.306124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:05.327055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 101/196] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:43:05 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:43:05.335295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f5d36-ceee-413e-890e-e7f2cd7028e0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:05.442119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd943e-3369-4f55-8618-50f7259e78c2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:05.492500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafc084-710f-4bfc-b7dd-71dcb2ff9990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:05.493223 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafc084-710f-4bfc-b7dd-71dcb2ff9990 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:05.493506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafc084-710f-4bfc-b7dd-71dcb2ff9990 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:05.493787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafc084-710f-4bfc-b7dd-71dcb2ff9990 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:05.494611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafc084-710f-4bfc-b7dd-71dcb2ff9990 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:05.494926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafc084-710f-4bfc-b7dd-71dcb2ff9990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:05.498136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafc084-710f-4bfc-b7dd-71dcb2ff9990 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:05.509195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 96/197] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:05.510861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafc084-710f-4bfc-b7dd-71dcb2ff9990 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:05.517747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f5d36-ceee-413e-890e-e7f2cd7028e0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:05.549631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:05.571489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7866-ace7-4726-94ce-4a171569320f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:05.572794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7866-ace7-4726-94ce-4a171569320f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:05.573224 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7866-ace7-4726-94ce-4a171569320f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:05.573497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7866-ace7-4726-94ce-4a171569320f None admin] PATH_INFO: `/v3/users/b0a11d8c08574daab9ad9ae8d88a93e5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:05.575026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7866-ace7-4726-94ce-4a171569320f None admin] RBAC: Authorizing `identity:get_user(user_id=b0a11d8c08574daab9ad9ae8d88a93e5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:05.576570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7866-ace7-4726-94ce-4a171569320f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:05.579387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 102/198] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:05 2022] GET /identity/v3/users/b0a11d8c08574daab9ad9ae8d88a93e5 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:05.580549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7866-ace7-4726-94ce-4a171569320f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:05.624708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:05.674970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafc084-710f-4bfc-b7dd-71dcb2ff9990 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:05.719633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f48cc-6d44-4995-a1d3-36f3cf6bf890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:05.719633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f48cc-6d44-4995-a1d3-36f3cf6bf890 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:05.719633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f48cc-6d44-4995-a1d3-36f3cf6bf890 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:05.720116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f48cc-6d44-4995-a1d3-36f3cf6bf890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:05.744819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7866-ace7-4726-94ce-4a171569320f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:05.806797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f09056-4384-4c3d-9a70-356fe66d12c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:05.807963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f09056-4384-4c3d-9a70-356fe66d12c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:05.808437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f09056-4384-4c3d-9a70-356fe66d12c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:05.808851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f09056-4384-4c3d-9a70-356fe66d12c3 None admin] PATH_INFO: `/v3/users/6f6253a91a884428b640e38261d8352f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:05.810367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f09056-4384-4c3d-9a70-356fe66d12c3 None admin] RBAC: Authorizing `identity:get_user(user_id=6f6253a91a884428b640e38261d8352f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:05.812051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f09056-4384-4c3d-9a70-356fe66d12c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:05.814757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 103/199] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:05 2022] GET /identity/v3/users/6f6253a91a884428b640e38261d8352f => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:05.815723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f09056-4384-4c3d-9a70-356fe66d12c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:05.838064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f48cc-6d44-4995-a1d3-36f3cf6bf890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:05.839848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f48cc-6d44-4995-a1d3-36f3cf6bf890 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:05.897234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:05.924636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:05.959840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f09056-4384-4c3d-9a70-356fe66d12c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:05.964588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 97/200] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:05.965605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f48cc-6d44-4995-a1d3-36f3cf6bf890 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:06.000889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcf481-c6ea-496e-90d1-61f2ac0cabce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:06.002285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcf481-c6ea-496e-90d1-61f2ac0cabce None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:06.002713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcf481-c6ea-496e-90d1-61f2ac0cabce None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:06.003131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcf481-c6ea-496e-90d1-61f2ac0cabce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:06.088194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f48cc-6d44-4995-a1d3-36f3cf6bf890 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:06.094590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcf481-c6ea-496e-90d1-61f2ac0cabce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:06.096169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcf481-c6ea-496e-90d1-61f2ac0cabce None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:06.142622 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b01bf-4561-46e0-a8d7-0b6e7a72ba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:06.143586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b01bf-4561-46e0-a8d7-0b6e7a72ba8a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:06.143881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b01bf-4561-46e0-a8d7-0b6e7a72ba8a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:06.145190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b01bf-4561-46e0-a8d7-0b6e7a72ba8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:06.175987 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:06.211096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:06.246830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 104/201] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:06.250191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b01bf-4561-46e0-a8d7-0b6e7a72ba8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:06.251474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcf481-c6ea-496e-90d1-61f2ac0cabce None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:06.251823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b01bf-4561-46e0-a8d7-0b6e7a72ba8a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:06.441892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcf481-c6ea-496e-90d1-61f2ac0cabce None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:06.462119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 98/202] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:06.462119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b01bf-4561-46e0-a8d7-0b6e7a72ba8a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:06.532492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3637c9-d568-4c4b-bd2d-d937000a98d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:06.534923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3637c9-d568-4c4b-bd2d-d937000a98d5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:06.535450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3637c9-d568-4c4b-bd2d-d937000a98d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:06.535960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3637c9-d568-4c4b-bd2d-d937000a98d5 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:06.539125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3637c9-d568-4c4b-bd2d-d937000a98d5 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:06.543266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3637c9-d568-4c4b-bd2d-d937000a98d5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:06.552990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 105/203] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:06 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:06.552990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3637c9-d568-4c4b-bd2d-d937000a98d5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:06.580809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:06.618929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:06.625053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b01bf-4561-46e0-a8d7-0b6e7a72ba8a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:06.687646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079f317-de26-4a3f-829c-791186a2462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:06.689538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079f317-de26-4a3f-829c-791186a2462f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:06.690034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079f317-de26-4a3f-829c-791186a2462f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:06.691481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079f317-de26-4a3f-829c-791186a2462f None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:06.695483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079f317-de26-4a3f-829c-791186a2462f None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:06.699648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079f317-de26-4a3f-829c-791186a2462f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:06.709561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 99/204] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:06 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:06.709561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079f317-de26-4a3f-829c-791186a2462f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:06.749558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3637c9-d568-4c4b-bd2d-d937000a98d5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:06.823755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd13c0-292b-406a-8a15-cca0ad13ba35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:06.824913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd13c0-292b-406a-8a15-cca0ad13ba35 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:06.825207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd13c0-292b-406a-8a15-cca0ad13ba35 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:06.825605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd13c0-292b-406a-8a15-cca0ad13ba35 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:06.827367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd13c0-292b-406a-8a15-cca0ad13ba35 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:06.829025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd13c0-292b-406a-8a15-cca0ad13ba35 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:06.831523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 106/205] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:06 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:06.832871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd13c0-292b-406a-8a15-cca0ad13ba35 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:06.897461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079f317-de26-4a3f-829c-791186a2462f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:06.962268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d48dd-e2e4-49af-a5fd-55eb7b9e3512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:06.964685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d48dd-e2e4-49af-a5fd-55eb7b9e3512 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:06.965436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d48dd-e2e4-49af-a5fd-55eb7b9e3512 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:06.966257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d48dd-e2e4-49af-a5fd-55eb7b9e3512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:06.968172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d48dd-e2e4-49af-a5fd-55eb7b9e3512 None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236, user.id=6f6253a91a884428b640e38261d8352f) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:06.969062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d48dd-e2e4-49af-a5fd-55eb7b9e3512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:06.972095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d48dd-e2e4-49af-a5fd-55eb7b9e3512 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:06.975736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:06.983342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 100/206] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:06 2022] GET /identity/v3/role_assignments?user.id=6f6253a91a884428b640e38261d8352f&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:06.985046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d48dd-e2e4-49af-a5fd-55eb7b9e3512 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:06.998187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd13c0-292b-406a-8a15-cca0ad13ba35 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:07.002452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:07.059792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b1b2-d4cc-4f88-bebd-1417e74911f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:07.060495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b1b2-d4cc-4f88-bebd-1417e74911f1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:07.060778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b1b2-d4cc-4f88-bebd-1417e74911f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:07.061046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b1b2-d4cc-4f88-bebd-1417e74911f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:07.061918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48b1b2-d4cc-4f88-bebd-1417e74911f1 None admin] RBAC: Adding query filter params (role.id=443ff5b7485a44109a9411b445079892, scope.project.id=255f1d6d50524cb9927e19bc3f010eae, user.id=b0a11d8c08574daab9ad9ae8d88a93e5) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:07.062265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48b1b2-d4cc-4f88-bebd-1417e74911f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:07.065676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48b1b2-d4cc-4f88-bebd-1417e74911f1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:07.078498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 107/207] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:06 2022] GET /identity/v3/role_assignments?user.id=b0a11d8c08574daab9ad9ae8d88a93e5&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=443ff5b7485a44109a9411b445079892 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:07.231898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d48dd-e2e4-49af-a5fd-55eb7b9e3512 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:07.274858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b160c9b-a455-4f58-b785-c050724206fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:07.275684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b160c9b-a455-4f58-b785-c050724206fe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:07.275970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b160c9b-a455-4f58-b785-c050724206fe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:07.276253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b160c9b-a455-4f58-b785-c050724206fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:07.277143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b160c9b-a455-4f58-b785-c050724206fe None admin] RBAC: Adding query filter params (role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236, user.id=6f6253a91a884428b640e38261d8352f) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:07.277470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b160c9b-a455-4f58-b785-c050724206fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:07.279088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b160c9b-a455-4f58-b785-c050724206fe None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:07.286467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 101/208] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:06 2022] GET /identity/v3/role_assignments?user.id=6f6253a91a884428b640e38261d8352f&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=1a772cde30724b09b110b5dffecfd462 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:08.193123 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8127860-dada-4346-8b03-a40757a0cbc2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:08.194928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8127860-dada-4346-8b03-a40757a0cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:08.195547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8127860-dada-4346-8b03-a40757a0cbc2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:08.198049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 108/209] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:08.206685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8627a59-0d4e-4bb2-a2cd-3bc5763e8523 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:08.207483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8627a59-0d4e-4bb2-a2cd-3bc5763e8523 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:08.207800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8627a59-0d4e-4bb2-a2cd-3bc5763e8523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:08.235273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f8627a59-0d4e-4bb2-a2cd-3bc5763e8523 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:08.237448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f8627a59-0d4e-4bb2-a2cd-3bc5763e8523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:08.338142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:08.347294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 102/210] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:08.372647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8127860-dada-4346-8b03-a40757a0cbc2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:08.498472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8127860-dada-4346-8b03-a40757a0cbc2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:08.508715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefb4f8-7e7e-425a-a18b-298324a43b43 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:08.509620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefb4f8-7e7e-425a-a18b-298324a43b43 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:08.510395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefb4f8-7e7e-425a-a18b-298324a43b43 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:08.518242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 103/211] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:08.522604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617a792-61e6-4630-9912-7da9c94c6d49 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:08.523412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617a792-61e6-4630-9912-7da9c94c6d49 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:08.524114 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617a792-61e6-4630-9912-7da9c94c6d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:08.538693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d6b2d-25c9-4e6e-9456-325b33d063ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:08.539541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d6b2d-25c9-4e6e-9456-325b33d063ad None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:08.539820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d6b2d-25c9-4e6e-9456-325b33d063ad None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:08.540094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d6b2d-25c9-4e6e-9456-325b33d063ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:08.541329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d6b2d-25c9-4e6e-9456-325b33d063ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:08.542894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d6b2d-25c9-4e6e-9456-325b33d063ad None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:08.544854 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 109/212] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:08.554134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d6b2d-25c9-4e6e-9456-325b33d063ad None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:08.558158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2617a792-61e6-4630-9912-7da9c94c6d49 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:08.559799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2617a792-61e6-4630-9912-7da9c94c6d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:08.584699 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:08.652062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 104/213] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:08.691423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d6b2d-25c9-4e6e-9456-325b33d063ad None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:08.692843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617a792-61e6-4630-9912-7da9c94c6d49 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:08.740748 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dff31-88cc-464e-aa3d-bfd2a0a4a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:08.741857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dff31-88cc-464e-aa3d-bfd2a0a4a5bf None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:08.742895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dff31-88cc-464e-aa3d-bfd2a0a4a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:08.743322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dff31-88cc-464e-aa3d-bfd2a0a4a5bf None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:08.744616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dff31-88cc-464e-aa3d-bfd2a0a4a5bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:08.746669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dff31-88cc-464e-aa3d-bfd2a0a4a5bf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:08.776923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 110/214] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:43:08 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:43:08.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617a792-61e6-4630-9912-7da9c94c6d49 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:08.870197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:08.881831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7f760-8c86-45a6-92ce-8fd577f57edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:08.882737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7f760-8c86-45a6-92ce-8fd577f57edc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:08.883021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7f760-8c86-45a6-92ce-8fd577f57edc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:08.883300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7f760-8c86-45a6-92ce-8fd577f57edc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:08.897333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7f760-8c86-45a6-92ce-8fd577f57edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9bb7f760-8c86-45a6-92ce-8fd577f57edc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:08.906795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:08.907748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:08.908514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 105/215] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:08.917501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dff31-88cc-464e-aa3d-bfd2a0a4a5bf None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:09.029787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:09.062868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dff31-88cc-464e-aa3d-bfd2a0a4a5bf None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:09.127348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d630a-e7cf-4c5c-9921-7f67bc4794f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:09.128943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d630a-e7cf-4c5c-9921-7f67bc4794f8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:09.129670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d630a-e7cf-4c5c-9921-7f67bc4794f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:09.130215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d630a-e7cf-4c5c-9921-7f67bc4794f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:09.131803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d630a-e7cf-4c5c-9921-7f67bc4794f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:09.132367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d630a-e7cf-4c5c-9921-7f67bc4794f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:09.135269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d630a-e7cf-4c5c-9921-7f67bc4794f8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:09.154815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 111/216] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:09.163302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7f760-8c86-45a6-92ce-8fd577f57edc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:09.350945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7f760-8c86-45a6-92ce-8fd577f57edc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:09.406433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0367e-3557-4087-94eb-f7d1fa9d7a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:09.407452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0367e-3557-4087-94eb-f7d1fa9d7a05 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:09.407751 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0367e-3557-4087-94eb-f7d1fa9d7a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:09.408022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0367e-3557-4087-94eb-f7d1fa9d7a05 None admin] PATH_INFO: `/v3/users/d3794da05d5440d9b2c8bc371609dd43` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:09.433972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0367e-3557-4087-94eb-f7d1fa9d7a05 None admin] RBAC: Authorizing `identity:get_user(user_id=d3794da05d5440d9b2c8bc371609dd43)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:09.435635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0367e-3557-4087-94eb-f7d1fa9d7a05 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:09.437504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 106/217] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:09 2022] GET /identity/v3/users/d3794da05d5440d9b2c8bc371609dd43 => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:09.446768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d630a-e7cf-4c5c-9921-7f67bc4794f8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:09.541813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff40105-0317-4f05-917b-11fabb40b707 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:09.542526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff40105-0317-4f05-917b-11fabb40b707 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:09.544287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff40105-0317-4f05-917b-11fabb40b707 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:09.555747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 107/218] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:09 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:09.562364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec14b5b-1c46-43cf-8597-9c5e7d598851 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:09.562791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec14b5b-1c46-43cf-8597-9c5e7d598851 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:09.563303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec14b5b-1c46-43cf-8597-9c5e7d598851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:09.611206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d630a-e7cf-4c5c-9921-7f67bc4794f8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:09.623957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3ec14b5b-1c46-43cf-8597-9c5e7d598851 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:09.626050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3ec14b5b-1c46-43cf-8597-9c5e7d598851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:09.654124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601e5ee-5d4f-471a-9df2-ac7959f1d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:09.655227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601e5ee-5d4f-471a-9df2-ac7959f1d14a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:09.655707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601e5ee-5d4f-471a-9df2-ac7959f1d14a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:09.656217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601e5ee-5d4f-471a-9df2-ac7959f1d14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:09.675586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:09.739681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601e5ee-5d4f-471a-9df2-ac7959f1d14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:09.741957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601e5ee-5d4f-471a-9df2-ac7959f1d14a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:09.772651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:09.836825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 108/219] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:09.866012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 112/220] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:09.870117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec14b5b-1c46-43cf-8597-9c5e7d598851 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:09.895809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601e5ee-5d4f-471a-9df2-ac7959f1d14a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:10.018258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:10.067980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec14b5b-1c46-43cf-8597-9c5e7d598851 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:10.111083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601e5ee-5d4f-471a-9df2-ac7959f1d14a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:10.132425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfd1b3-8cfc-40ce-808a-9d9daa9e7e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:10.133895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfd1b3-8cfc-40ce-808a-9d9daa9e7e2a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:10.134721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfd1b3-8cfc-40ce-808a-9d9daa9e7e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:10.134970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfd1b3-8cfc-40ce-808a-9d9daa9e7e2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:10.154875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfd1b3-8cfc-40ce-808a-9d9daa9e7e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:10.155453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734781e3-1556-4d9e-a5a0-039115d8fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:10.156615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734781e3-1556-4d9e-a5a0-039115d8fd9d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:10.157103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734781e3-1556-4d9e-a5a0-039115d8fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:10.157603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734781e3-1556-4d9e-a5a0-039115d8fd9d None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:10.159193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734781e3-1556-4d9e-a5a0-039115d8fd9d None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:10.160925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734781e3-1556-4d9e-a5a0-039115d8fd9d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:10.163593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 113/221] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:09 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:10.165124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63f91-7921-499b-8d13-787a1b05e859 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:10.165609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63f91-7921-499b-8d13-787a1b05e859 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:10.166075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63f91-7921-499b-8d13-787a1b05e859 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:10.168147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 114/222] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:10.174844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a039d8-acec-4f78-aed2-1072ff70045a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:10.175450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a039d8-acec-4f78-aed2-1072ff70045a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:10.176008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a039d8-acec-4f78-aed2-1072ff70045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-17bfd1b3-8cfc-40ce-808a-9d9daa9e7e2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:10.179312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:10.180227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:10.181073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:10.182177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 109/223] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:43:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:10.183635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfd1b3-8cfc-40ce-808a-9d9daa9e7e2a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:10.201505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-75a039d8-acec-4f78-aed2-1072ff70045a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:10.203210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-75a039d8-acec-4f78-aed2-1072ff70045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:10.248520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:10.330131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 115/224] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:10.330131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a039d8-acec-4f78-aed2-1072ff70045a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:10.383249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfd1b3-8cfc-40ce-808a-9d9daa9e7e2a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:10.421061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:10.426608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54a945-bc48-4648-98e8-0fa8b4e0c265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:10.428048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54a945-bc48-4648-98e8-0fa8b4e0c265 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:10.428616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54a945-bc48-4648-98e8-0fa8b4e0c265 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:10.429087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54a945-bc48-4648-98e8-0fa8b4e0c265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:10.430199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54a945-bc48-4648-98e8-0fa8b4e0c265 None admin] RBAC: Adding query filter params (role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236, user.id=d3794da05d5440d9b2c8bc371609dd43) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:10.431256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54a945-bc48-4648-98e8-0fa8b4e0c265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:10.433462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54a945-bc48-4648-98e8-0fa8b4e0c265 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:10.441429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 110/225] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:10 2022] GET /identity/v3/role_assignments?user.id=d3794da05d5440d9b2c8bc371609dd43&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=3d852826ac0a4f09b618a220333f2897 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:10.442866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54a945-bc48-4648-98e8-0fa8b4e0c265 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:10.563398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:10.567544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54a945-bc48-4648-98e8-0fa8b4e0c265 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:10.612365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a039d8-acec-4f78-aed2-1072ff70045a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:10.657287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d69213-a31b-46cd-96ff-a1db20ef75ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:10.658075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d69213-a31b-46cd-96ff-a1db20ef75ff None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:10.658396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d69213-a31b-46cd-96ff-a1db20ef75ff None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:10.658774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d69213-a31b-46cd-96ff-a1db20ef75ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:10.684665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d69213-a31b-46cd-96ff-a1db20ef75ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-57d69213-a31b-46cd-96ff-a1db20ef75ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:10.701437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:10.702459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:10.703265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:10.703932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 111/226] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:10.710554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad6e9e-45d2-4b8b-a842-1147a79cdabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:10.711302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad6e9e-45d2-4b8b-a842-1147a79cdabf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:10.711581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad6e9e-45d2-4b8b-a842-1147a79cdabf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:10.711853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad6e9e-45d2-4b8b-a842-1147a79cdabf None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:10.712822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad6e9e-45d2-4b8b-a842-1147a79cdabf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:10.713335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad6e9e-45d2-4b8b-a842-1147a79cdabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:10.714895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad6e9e-45d2-4b8b-a842-1147a79cdabf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:10.715220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d69213-a31b-46cd-96ff-a1db20ef75ff None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:10.725598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 116/227] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:10.732781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad6e9e-45d2-4b8b-a842-1147a79cdabf None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:10.955839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad6e9e-45d2-4b8b-a842-1147a79cdabf None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:10.960570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:10.971732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d69213-a31b-46cd-96ff-a1db20ef75ff None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:11.026569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8641a31-e58b-479f-946c-810db773323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:11.027520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8641a31-e58b-479f-946c-810db773323f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:11.027875 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8641a31-e58b-479f-946c-810db773323f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:11.028153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8641a31-e58b-479f-946c-810db773323f None admin] PATH_INFO: `/v3/users/6f6253a91a884428b640e38261d8352f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:11.029469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8641a31-e58b-479f-946c-810db773323f None admin] RBAC: Authorizing `identity:get_user(user_id=6f6253a91a884428b640e38261d8352f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:11.031034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8641a31-e58b-479f-946c-810db773323f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:11.034703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 117/228] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:10 2022] GET /identity/v3/users/6f6253a91a884428b640e38261d8352f => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:11.048407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8641a31-e58b-479f-946c-810db773323f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:11.055371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb428b9-a4a4-4563-9679-48f8ac9387f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:11.056258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb428b9-a4a4-4563-9679-48f8ac9387f9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:11.056607 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb428b9-a4a4-4563-9679-48f8ac9387f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:11.057060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb428b9-a4a4-4563-9679-48f8ac9387f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:11.063068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb428b9-a4a4-4563-9679-48f8ac9387f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:11.063391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb428b9-a4a4-4563-9679-48f8ac9387f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:11.064989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb428b9-a4a4-4563-9679-48f8ac9387f9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:11.091608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 112/229] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:11.096602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb428b9-a4a4-4563-9679-48f8ac9387f9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:11.151665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:11.202292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8641a31-e58b-479f-946c-810db773323f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:11.275479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bf5e1-98de-46f0-ad37-2718c361c7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:11.276311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf5e1-98de-46f0-ad37-2718c361c7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:11.276591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf5e1-98de-46f0-ad37-2718c361c7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:11.276866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf5e1-98de-46f0-ad37-2718c361c7c3 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:11.279722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bf5e1-98de-46f0-ad37-2718c361c7c3 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:11.281253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bf5e1-98de-46f0-ad37-2718c361c7c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:11.283244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 118/230] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:11 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:11.291976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bf5e1-98de-46f0-ad37-2718c361c7c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:11.350902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb428b9-a4a4-4563-9679-48f8ac9387f9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:11.373951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:11.448037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474aebc-379e-482d-b149-1d291273c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:11.449695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474aebc-379e-482d-b149-1d291273c128 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:11.450214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474aebc-379e-482d-b149-1d291273c128 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:11.450707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474aebc-379e-482d-b149-1d291273c128 None admin] PATH_INFO: `/v3/users/6f6253a91a884428b640e38261d8352f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:11.452393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474aebc-379e-482d-b149-1d291273c128 None admin] RBAC: Authorizing `identity:get_user(user_id=6f6253a91a884428b640e38261d8352f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:11.454320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474aebc-379e-482d-b149-1d291273c128 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:11.457409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 113/231] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:11 2022] GET /identity/v3/users/6f6253a91a884428b640e38261d8352f => generated 283 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:11.478884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474aebc-379e-482d-b149-1d291273c128 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:11.524577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bf5e1-98de-46f0-ad37-2718c361c7c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:11.614449 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:11.636383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aaa19-e3b6-4db1-a70a-b4567fec1ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:11.637397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aaa19-e3b6-4db1-a70a-b4567fec1ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:11.637775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aaa19-e3b6-4db1-a70a-b4567fec1ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:11.638130 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aaa19-e3b6-4db1-a70a-b4567fec1ae3 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/users/6f6253a91a884428b640e38261d8352f/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:11.639710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474aebc-379e-482d-b149-1d291273c128 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:11.643674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aaa19-e3b6-4db1-a70a-b4567fec1ae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=02114f3d5b0740a3bccbe7d0edb81236, user_id=6f6253a91a884428b640e38261d8352f, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:11.645435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aaa19-e3b6-4db1-a70a-b4567fec1ae3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:11.681146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 119/232] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:43:11 2022] PUT /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/users/6f6253a91a884428b640e38261d8352f/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:11.698229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad71b30-5a3e-440a-bf68-ce84b89fa8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:11.699315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71b30-5a3e-440a-bf68-ce84b89fa8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:11.699605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71b30-5a3e-440a-bf68-ce84b89fa8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:11.699888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71b30-5a3e-440a-bf68-ce84b89fa8c6 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:11.707504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad71b30-5a3e-440a-bf68-ce84b89fa8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:11.709417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad71b30-5a3e-440a-bf68-ce84b89fa8c6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:11.712296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 114/233] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:11 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:11.719705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aaa19-e3b6-4db1-a70a-b4567fec1ae3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:11.945368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:11.948916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aaa19-e3b6-4db1-a70a-b4567fec1ae3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:11.998312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988bfbd-6330-45de-850e-bd97d29b217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:11.999291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988bfbd-6330-45de-850e-bd97d29b217a None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:11.999576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988bfbd-6330-45de-850e-bd97d29b217a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:11.999720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466c865-d634-4831-895b-ee3114cbd5ea None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:11.999871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988bfbd-6330-45de-850e-bd97d29b217a None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/users/6f6253a91a884428b640e38261d8352f/roles/1a772cde30724b09b110b5dffecfd462` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:12.000017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466c865-d634-4831-895b-ee3114cbd5ea None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:12.000734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466c865-d634-4831-895b-ee3114cbd5ea None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:12.003729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988bfbd-6330-45de-850e-bd97d29b217a None admin] RBAC: Authorizing `identity:create_grant(project_id=02114f3d5b0740a3bccbe7d0edb81236, user_id=6f6253a91a884428b640e38261d8352f, role_id=1a772cde30724b09b110b5dffecfd462)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:12.010253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988bfbd-6330-45de-850e-bd97d29b217a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:12.010762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 115/234] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:12.014715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccb48a-e902-459e-bf09-29cfe39531f2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:12.015756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccb48a-e902-459e-bf09-29cfe39531f2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:12.016699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccb48a-e902-459e-bf09-29cfe39531f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:12.038785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 120/235] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:43:11 2022] PUT /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/users/6f6253a91a884428b640e38261d8352f/roles/1a772cde30724b09b110b5dffecfd462 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:12.045760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-21ccb48a-e902-459e-bf09-29cfe39531f2 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:12.048439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-21ccb48a-e902-459e-bf09-29cfe39531f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:12.200264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45261e6f-0657-4949-8024-0a7aaaf55056 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:12.200617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45261e6f-0657-4949-8024-0a7aaaf55056 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:12.200844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45261e6f-0657-4949-8024-0a7aaaf55056 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:12.202421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 121/236] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:12.208361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9754c5-8a90-4e8a-8eb1-116f142267cb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:12.209060 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9754c5-8a90-4e8a-8eb1-116f142267cb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:12.209596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9754c5-8a90-4e8a-8eb1-116f142267cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:12.221820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 116/237] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:12.258931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bb9754c5-8a90-4e8a-8eb1-116f142267cb None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:12.259280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccb48a-e902-459e-bf09-29cfe39531f2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:12.260716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bb9754c5-8a90-4e8a-8eb1-116f142267cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:12.447129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 122/238] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:12.448394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:12.468708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccb48a-e902-459e-bf09-29cfe39531f2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:12.482688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9754c5-8a90-4e8a-8eb1-116f142267cb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:12.517334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534316c8-7e83-42cf-a428-be24a5c5f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:12.518545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534316c8-7e83-42cf-a428-be24a5c5f49e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:12.518983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534316c8-7e83-42cf-a428-be24a5c5f49e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:12.519398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534316c8-7e83-42cf-a428-be24a5c5f49e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:12.540611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534316c8-7e83-42cf-a428-be24a5c5f49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-534316c8-7e83-42cf-a428-be24a5c5f49e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:12.551599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:12.552623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:12.553662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:12.557410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 117/239] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:12.565143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534316c8-7e83-42cf-a428-be24a5c5f49e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:12.654652 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:12.670762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9754c5-8a90-4e8a-8eb1-116f142267cb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:12.735604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534316c8-7e83-42cf-a428-be24a5c5f49e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:12.737768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d526f-97ac-4a15-ac18-3930373976fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:12.739113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d526f-97ac-4a15-ac18-3930373976fa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:12.739613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d526f-97ac-4a15-ac18-3930373976fa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:12.740172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d526f-97ac-4a15-ac18-3930373976fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:12.745196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d526f-97ac-4a15-ac18-3930373976fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:12.747197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d526f-97ac-4a15-ac18-3930373976fa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:12.749574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 123/240] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:12.755852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d526f-97ac-4a15-ac18-3930373976fa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:12.792808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09430b0f-a1c7-45aa-9fd4-f074931e48d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:12.793585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09430b0f-a1c7-45aa-9fd4-f074931e48d8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:12.793871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09430b0f-a1c7-45aa-9fd4-f074931e48d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:12.794166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09430b0f-a1c7-45aa-9fd4-f074931e48d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:12.794982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09430b0f-a1c7-45aa-9fd4-f074931e48d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:12.795293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09430b0f-a1c7-45aa-9fd4-f074931e48d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:12.796809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09430b0f-a1c7-45aa-9fd4-f074931e48d8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:12.812818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 118/241] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:12.820995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09430b0f-a1c7-45aa-9fd4-f074931e48d8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:12.838571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:12.943856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09430b0f-a1c7-45aa-9fd4-f074931e48d8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:12.982395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb5635-fef2-43a8-9463-b18b0e951fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:12.983341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb5635-fef2-43a8-9463-b18b0e951fab None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:12.983623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb5635-fef2-43a8-9463-b18b0e951fab None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:12.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb5635-fef2-43a8-9463-b18b0e951fab None admin] PATH_INFO: `/v3/users/aedbc4e63aff435599840c5276334ed1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:13.001242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb5635-fef2-43a8-9463-b18b0e951fab None admin] RBAC: Authorizing `identity:get_user(user_id=aedbc4e63aff435599840c5276334ed1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:13.002850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb5635-fef2-43a8-9463-b18b0e951fab None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:13.005090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 119/242] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:12 2022] GET /identity/v3/users/aedbc4e63aff435599840c5276334ed1 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:13.015219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb5635-fef2-43a8-9463-b18b0e951fab None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:13.069827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d526f-97ac-4a15-ac18-3930373976fa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:13.136015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e558b-1e01-4613-9fa6-f0d454f5cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:13.136742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e558b-1e01-4613-9fa6-f0d454f5cfba None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:13.137027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e558b-1e01-4613-9fa6-f0d454f5cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:13.137321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e558b-1e01-4613-9fa6-f0d454f5cfba None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:13.138162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e558b-1e01-4613-9fa6-f0d454f5cfba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:13.139967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e558b-1e01-4613-9fa6-f0d454f5cfba None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:13.158499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:13.180349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 124/243] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:43:12 2022] POST /identity/v3/users => generated 293 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:43:13.215376 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb5635-fef2-43a8-9463-b18b0e951fab None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:13.265878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c44e1-4e7c-426c-8b44-d78e444980c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:13.266728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c44e1-4e7c-426c-8b44-d78e444980c1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:13.267037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c44e1-4e7c-426c-8b44-d78e444980c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:13.267333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c44e1-4e7c-426c-8b44-d78e444980c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:13.403004 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c44e1-4e7c-426c-8b44-d78e444980c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:13.404622 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c44e1-4e7c-426c-8b44-d78e444980c1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:13.479120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da723d9-f495-4431-b1a0-c556de5df234 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:13.479417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da723d9-f495-4431-b1a0-c556de5df234 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:13.479724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da723d9-f495-4431-b1a0-c556de5df234 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:13.481395 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 125/244] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:13.488579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5853b-aad4-40f6-a9a0-4161602cdb1f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:13.489241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5853b-aad4-40f6-a9a0-4161602cdb1f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:13.489755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5853b-aad4-40f6-a9a0-4161602cdb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:13.508695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:13.519161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-cad5853b-aad4-40f6-a9a0-4161602cdb1f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:13.520715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cad5853b-aad4-40f6-a9a0-4161602cdb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:13.536533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:13.563406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 120/245] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:13.570460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c44e1-4e7c-426c-8b44-d78e444980c1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:13.644063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 126/246] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:13.673194 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5853b-aad4-40f6-a9a0-4161602cdb1f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:13.741150 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c44e1-4e7c-426c-8b44-d78e444980c1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:13.795061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3dcc-cbd0-4d6c-8271-93112abeb7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:13.796432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3dcc-cbd0-4d6c-8271-93112abeb7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:13.796866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3dcc-cbd0-4d6c-8271-93112abeb7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:13.797451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3dcc-cbd0-4d6c-8271-93112abeb7a0 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:13.800773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae3dcc-cbd0-4d6c-8271-93112abeb7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:13.803882 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae3dcc-cbd0-4d6c-8271-93112abeb7a0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:13.806903 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5853b-aad4-40f6-a9a0-4161602cdb1f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:13.807770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 121/247] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:13 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:13.819661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3dcc-cbd0-4d6c-8271-93112abeb7a0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:13.857467 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23f2f0-32da-4edc-b53f-8d55c4074794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:13.858468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f2f0-32da-4edc-b53f-8d55c4074794 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:13.858746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f2f0-32da-4edc-b53f-8d55c4074794 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:13.859145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23f2f0-32da-4edc-b53f-8d55c4074794 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:13.877931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23f2f0-32da-4edc-b53f-8d55c4074794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:13.887371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4b23f2f0-32da-4edc-b53f-8d55c4074794 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:13.888384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:13.889478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:13.896166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 127/248] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:13.899509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23f2f0-32da-4edc-b53f-8d55c4074794 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:13.904065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:14.016902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3dcc-cbd0-4d6c-8271-93112abeb7a0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:14.079355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23f2f0-32da-4edc-b53f-8d55c4074794 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:14.081691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d53bc-3bba-4957-bba4-70d89c1fa620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:14.084006 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d53bc-3bba-4957-bba4-70d89c1fa620 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:14.084412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d53bc-3bba-4957-bba4-70d89c1fa620 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:14.084931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d53bc-3bba-4957-bba4-70d89c1fa620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:14.086541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d53bc-3bba-4957-bba4-70d89c1fa620 None admin] RBAC: Adding query filter params (role.id=443ff5b7485a44109a9411b445079892, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236, user.id=aedbc4e63aff435599840c5276334ed1) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:14.087086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d53bc-3bba-4957-bba4-70d89c1fa620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:14.089305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d53bc-3bba-4957-bba4-70d89c1fa620 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:14.104796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 122/249] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:13 2022] GET /identity/v3/role_assignments?user.id=aedbc4e63aff435599840c5276334ed1&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=443ff5b7485a44109a9411b445079892 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:14.143415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb118f1-1f88-45f6-871f-b3ae11dc97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:14.144491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb118f1-1f88-45f6-871f-b3ae11dc97ea None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:14.144911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb118f1-1f88-45f6-871f-b3ae11dc97ea None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:14.145438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb118f1-1f88-45f6-871f-b3ae11dc97ea None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:14.146611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb118f1-1f88-45f6-871f-b3ae11dc97ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:14.147203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb118f1-1f88-45f6-871f-b3ae11dc97ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:14.150032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb118f1-1f88-45f6-871f-b3ae11dc97ea None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:14.167757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 128/250] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:14.176444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d53bc-3bba-4957-bba4-70d89c1fa620 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:14.372180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:14.380418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d53bc-3bba-4957-bba4-70d89c1fa620 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:14.447606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db67523-899c-4e3f-9c60-87b7fe906194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:14.449283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db67523-899c-4e3f-9c60-87b7fe906194 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:14.449757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db67523-899c-4e3f-9c60-87b7fe906194 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:14.450278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db67523-899c-4e3f-9c60-87b7fe906194 None admin] PATH_INFO: `/v3/users/d3794da05d5440d9b2c8bc371609dd43` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:14.452912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db67523-899c-4e3f-9c60-87b7fe906194 None admin] RBAC: Authorizing `identity:get_user(user_id=d3794da05d5440d9b2c8bc371609dd43)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:14.455126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db67523-899c-4e3f-9c60-87b7fe906194 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:14.457956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 123/251] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:14 2022] GET /identity/v3/users/d3794da05d5440d9b2c8bc371609dd43 => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:14.468167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb118f1-1f88-45f6-871f-b3ae11dc97ea None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:14.607653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:14.677428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb118f1-1f88-45f6-871f-b3ae11dc97ea None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:14.735222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c3d9c-557a-4fc1-8f56-b29bace067b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:14.736513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c3d9c-557a-4fc1-8f56-b29bace067b7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:14.737243 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c3d9c-557a-4fc1-8f56-b29bace067b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:14.737550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c3d9c-557a-4fc1-8f56-b29bace067b7 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:14.739406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c3d9c-557a-4fc1-8f56-b29bace067b7 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:14.741954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c3d9c-557a-4fc1-8f56-b29bace067b7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:14.744270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 129/252] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:14 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:14.751398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db67523-899c-4e3f-9c60-87b7fe906194 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:14.923646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db67523-899c-4e3f-9c60-87b7fe906194 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:14.989424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476dca-0621-4468-b0a1-c13c14a28309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:14.991283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476dca-0621-4468-b0a1-c13c14a28309 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:14.991639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476dca-0621-4468-b0a1-c13c14a28309 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:14.992028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476dca-0621-4468-b0a1-c13c14a28309 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/users/d3794da05d5440d9b2c8bc371609dd43/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:14.995690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9476dca-0621-4468-b0a1-c13c14a28309 None admin] RBAC: Authorizing `identity:create_grant(project_id=02114f3d5b0740a3bccbe7d0edb81236, user_id=d3794da05d5440d9b2c8bc371609dd43, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:14.998596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9476dca-0621-4468-b0a1-c13c14a28309 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:15.027586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 124/253] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:43:14 2022] PUT /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/users/d3794da05d5440d9b2c8bc371609dd43/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:15.040241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2ae2-215a-4437-abe5-357d95c6826a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:15.040774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2ae2-215a-4437-abe5-357d95c6826a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:15.041175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2ae2-215a-4437-abe5-357d95c6826a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:15.044300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 130/254] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:15.055994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0440b-6f5a-4c70-8ea3-303021ea49df None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:15.056341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dfc32-523b-4256-92b1-94b14d96f3ab None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:15.056497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0440b-6f5a-4c70-8ea3-303021ea49df None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:15.056497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0440b-6f5a-4c70-8ea3-303021ea49df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:15.056815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dfc32-523b-4256-92b1-94b14d96f3ab None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:15.056815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dfc32-523b-4256-92b1-94b14d96f3ab None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:15.058198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 131/255] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:15.067333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934aea2-68eb-423f-9682-b83e226205bc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:15.067991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934aea2-68eb-423f-9682-b83e226205bc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:15.068560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934aea2-68eb-423f-9682-b83e226205bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:15.107713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2ae0440b-6f5a-4c70-8ea3-303021ea49df None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:15.109421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2ae0440b-6f5a-4c70-8ea3-303021ea49df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:15.111216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1934aea2-68eb-423f-9682-b83e226205bc None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:15.116422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1934aea2-68eb-423f-9682-b83e226205bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:15.192692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:15.395948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 125/256] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:15.404507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 132/257] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:15.448888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0440b-6f5a-4c70-8ea3-303021ea49df None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:15.470891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934aea2-68eb-423f-9682-b83e226205bc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:15.634645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:15.681050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934aea2-68eb-423f-9682-b83e226205bc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:15.700069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0440b-6f5a-4c70-8ea3-303021ea49df None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:15.728731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f680fb8-cc8f-4a77-a26c-2fdc2e752a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:15.729914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f680fb8-cc8f-4a77-a26c-2fdc2e752a00 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:15.730391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f680fb8-cc8f-4a77-a26c-2fdc2e752a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:15.730893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f680fb8-cc8f-4a77-a26c-2fdc2e752a00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:15.746482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f680fb8-cc8f-4a77-a26c-2fdc2e752a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3f680fb8-cc8f-4a77-a26c-2fdc2e752a00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:15.756988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:15.758389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:15.759348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:15.761917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 133/258] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:43:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:15.770165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f680fb8-cc8f-4a77-a26c-2fdc2e752a00 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:15.798480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc2cb3-a892-461b-91f8-98efee087323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:15.800131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc2cb3-a892-461b-91f8-98efee087323 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:15.802491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc2cb3-a892-461b-91f8-98efee087323 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:15.803160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc2cb3-a892-461b-91f8-98efee087323 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:15.835993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc2cb3-a892-461b-91f8-98efee087323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b5dc2cb3-a892-461b-91f8-98efee087323 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:15.853521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:15.854481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:15.855395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:15.864049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 126/259] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:15.887682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc2cb3-a892-461b-91f8-98efee087323 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:15.936559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:16.016631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f680fb8-cc8f-4a77-a26c-2fdc2e752a00 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:16.052850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:16.065961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab60ae8-2cd8-42fe-a9e7-5e4b95e75d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:16.066984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab60ae8-2cd8-42fe-a9e7-5e4b95e75d46 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:16.067408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab60ae8-2cd8-42fe-a9e7-5e4b95e75d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:16.067846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab60ae8-2cd8-42fe-a9e7-5e4b95e75d46 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:16.068974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab60ae8-2cd8-42fe-a9e7-5e4b95e75d46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:16.069436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab60ae8-2cd8-42fe-a9e7-5e4b95e75d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:16.071379 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab60ae8-2cd8-42fe-a9e7-5e4b95e75d46 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:16.083134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 134/260] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:16.094343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab60ae8-2cd8-42fe-a9e7-5e4b95e75d46 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:16.166889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc2cb3-a892-461b-91f8-98efee087323 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:16.278038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98446635-39c0-4226-af35-920327ee6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:16.278833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98446635-39c0-4226-af35-920327ee6153 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:16.279116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98446635-39c0-4226-af35-920327ee6153 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:16.280857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98446635-39c0-4226-af35-920327ee6153 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:16.281712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98446635-39c0-4226-af35-920327ee6153 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:16.282023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98446635-39c0-4226-af35-920327ee6153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:16.283635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98446635-39c0-4226-af35-920327ee6153 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:16.315051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 127/261] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:16.323299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98446635-39c0-4226-af35-920327ee6153 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:16.431658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab60ae8-2cd8-42fe-a9e7-5e4b95e75d46 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:16.478392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:16.504906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2fa6c-4c78-4e5b-91cd-a0bc33459f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:16.506029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2fa6c-4c78-4e5b-91cd-a0bc33459f26 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:16.506499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2fa6c-4c78-4e5b-91cd-a0bc33459f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:16.506734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2fa6c-4c78-4e5b-91cd-a0bc33459f26 None admin] PATH_INFO: `/v3/users/6f6253a91a884428b640e38261d8352f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:16.508041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2fa6c-4c78-4e5b-91cd-a0bc33459f26 None admin] RBAC: Authorizing `identity:get_user(user_id=6f6253a91a884428b640e38261d8352f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:16.509138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98446635-39c0-4226-af35-920327ee6153 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:16.509617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2fa6c-4c78-4e5b-91cd-a0bc33459f26 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:16.520282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 135/262] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:16 2022] GET /identity/v3/users/6f6253a91a884428b640e38261d8352f => generated 283 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:16.526456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2fa6c-4c78-4e5b-91cd-a0bc33459f26 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:16.550048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3db44-3f6b-403d-98cf-4ad602e5cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:16.551744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3db44-3f6b-403d-98cf-4ad602e5cc30 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:16.552236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3db44-3f6b-403d-98cf-4ad602e5cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:16.552919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3db44-3f6b-403d-98cf-4ad602e5cc30 None admin] PATH_INFO: `/v3/users/6f6253a91a884428b640e38261d8352f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:16.554735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3db44-3f6b-403d-98cf-4ad602e5cc30 None admin] RBAC: Authorizing `identity:get_user(user_id=6f6253a91a884428b640e38261d8352f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:16.557278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3db44-3f6b-403d-98cf-4ad602e5cc30 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:16.560433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 128/263] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:16 2022] GET /identity/v3/users/6f6253a91a884428b640e38261d8352f => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:16.566457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3db44-3f6b-403d-98cf-4ad602e5cc30 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:16.641403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:16.701678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3db44-3f6b-403d-98cf-4ad602e5cc30 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:16.716668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2fa6c-4c78-4e5b-91cd-a0bc33459f26 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:16.752847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af0cc-dd8d-4460-a2cd-7fb6aaf4cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:16.753887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af0cc-dd8d-4460-a2cd-7fb6aaf4cf74 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:16.754356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af0cc-dd8d-4460-a2cd-7fb6aaf4cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:16.754926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af0cc-dd8d-4460-a2cd-7fb6aaf4cf74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:16.803614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:16.804338 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a1930-8e7e-47b9-894c-823258dc82fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:16.805116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a1930-8e7e-47b9-894c-823258dc82fc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:16.805786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a1930-8e7e-47b9-894c-823258dc82fc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:16.805915 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a1930-8e7e-47b9-894c-823258dc82fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:16.922798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729af0cc-dd8d-4460-a2cd-7fb6aaf4cf74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:16.925438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729af0cc-dd8d-4460-a2cd-7fb6aaf4cf74 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:16.952606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a1930-8e7e-47b9-894c-823258dc82fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:16.954180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a1930-8e7e-47b9-894c-823258dc82fc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:17.126778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:17.188305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 129/264] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:17.207725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af0cc-dd8d-4460-a2cd-7fb6aaf4cf74 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:17.278303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 136/265] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:17.285392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a1930-8e7e-47b9-894c-823258dc82fc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:17.347920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:17.446387 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af0cc-dd8d-4460-a2cd-7fb6aaf4cf74 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:17.497378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c780b01-94f2-417b-b543-2151657a7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:17.499935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c780b01-94f2-417b-b543-2151657a7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:17.510836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c780b01-94f2-417b-b543-2151657a7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:17.511632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c780b01-94f2-417b-b543-2151657a7ee1 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:17.515007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c780b01-94f2-417b-b543-2151657a7ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:17.518703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c780b01-94f2-417b-b543-2151657a7ee1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:17.522834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 130/266] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:17 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:17.525893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e3651-ea84-4190-8d14-b0dbc4700920 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:17.526705 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e3651-ea84-4190-8d14-b0dbc4700920 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:17.527378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e3651-ea84-4190-8d14-b0dbc4700920 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:17.531352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 131/267] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:17.536673 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e3651-ea84-4190-8d14-b0dbc4700920 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:17.622011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a1930-8e7e-47b9-894c-823258dc82fc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:17.703122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951a001-ab47-4fb8-a04f-f1fe402f5aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:17.705125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951a001-ab47-4fb8-a04f-f1fe402f5aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:17.705917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951a001-ab47-4fb8-a04f-f1fe402f5aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:17.706690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951a001-ab47-4fb8-a04f-f1fe402f5aa4 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:17.709557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951a001-ab47-4fb8-a04f-f1fe402f5aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:17.712707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951a001-ab47-4fb8-a04f-f1fe402f5aa4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:17.716295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 137/268] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:17 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:17.719028 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa5b7-2b88-494e-8b42-5ee8a531065c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:17.720506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa5b7-2b88-494e-8b42-5ee8a531065c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:17.721310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa5b7-2b88-494e-8b42-5ee8a531065c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:17.758750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3f2aa5b7-2b88-494e-8b42-5ee8a531065c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:17.762453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3f2aa5b7-2b88-494e-8b42-5ee8a531065c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:17.796010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:17.800006 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e3651-ea84-4190-8d14-b0dbc4700920 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:17.824645 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:17.858260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7eda-3adc-4f60-9b60-6473f9116eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:17.859299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7eda-3adc-4f60-9b60-6473f9116eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:17.859874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7eda-3adc-4f60-9b60-6473f9116eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:17.860431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7eda-3adc-4f60-9b60-6473f9116eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:17.862048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7eda-3adc-4f60-9b60-6473f9116eb6 None admin] RBAC: Adding query filter params (role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236, user.id=6f6253a91a884428b640e38261d8352f) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:17.862707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7eda-3adc-4f60-9b60-6473f9116eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:17.865131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7eda-3adc-4f60-9b60-6473f9116eb6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:17.875421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 132/269] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:17 2022] GET /identity/v3/role_assignments?user.id=6f6253a91a884428b640e38261d8352f&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=1a772cde30724b09b110b5dffecfd462 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:17.877373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcee35-b791-4931-bdc8-6a947a429ac6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:17.877815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcee35-b791-4931-bdc8-6a947a429ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:17.878274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 138/270] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:17.878435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcee35-b791-4931-bdc8-6a947a429ac6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:17.879519 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa5b7-2b88-494e-8b42-5ee8a531065c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:17.885878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 133/271] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:17.887857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4bcb7-ff01-4362-89aa-76f7b4756a07 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:17.888356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4bcb7-ff01-4362-89aa-76f7b4756a07 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:17.888842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4bcb7-ff01-4362-89aa-76f7b4756a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:17.908971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2bf4bcb7-ff01-4362-89aa-76f7b4756a07 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:17.910877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2bf4bcb7-ff01-4362-89aa-76f7b4756a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:18.000774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 134/272] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:18.007043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4bcb7-ff01-4362-89aa-76f7b4756a07 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:18.056843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa5b7-2b88-494e-8b42-5ee8a531065c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:18.150013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2688-5e7d-4216-a436-a8a0981ce505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:18.151210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2688-5e7d-4216-a436-a8a0981ce505 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:18.151663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2688-5e7d-4216-a436-a8a0981ce505 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:18.152114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2688-5e7d-4216-a436-a8a0981ce505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:18.153156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf2688-5e7d-4216-a436-a8a0981ce505 None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236, user.id=6f6253a91a884428b640e38261d8352f) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:18.153636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf2688-5e7d-4216-a436-a8a0981ce505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:18.155793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf2688-5e7d-4216-a436-a8a0981ce505 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:18.163567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 139/273] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:17 2022] GET /identity/v3/role_assignments?user.id=6f6253a91a884428b640e38261d8352f&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:18.164976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2688-5e7d-4216-a436-a8a0981ce505 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:18.168141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4bcb7-ff01-4362-89aa-76f7b4756a07 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:18.181905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:18.192786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:18.220021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62063989-f918-4d22-aa9a-226dcbe1270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:18.221457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62063989-f918-4d22-aa9a-226dcbe1270c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:18.221968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62063989-f918-4d22-aa9a-226dcbe1270c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:18.222665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62063989-f918-4d22-aa9a-226dcbe1270c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:18.225926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62063989-f918-4d22-aa9a-226dcbe1270c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:18.229793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62063989-f918-4d22-aa9a-226dcbe1270c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:18.234076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 135/274] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:18.237201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1de73-c500-46ed-b779-b4c2473b6db6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:18.238019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1de73-c500-46ed-b779-b4c2473b6db6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:18.238790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1de73-c500-46ed-b779-b4c2473b6db6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:18.241841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 136/275] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:18.243472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1de73-c500-46ed-b779-b4c2473b6db6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:18.354287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2688-5e7d-4216-a436-a8a0981ce505 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:18.408938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881e95e-c166-4e71-9458-d6cdd6a23a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:18.409844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e95e-c166-4e71-9458-d6cdd6a23a34 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:18.410208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e95e-c166-4e71-9458-d6cdd6a23a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:18.411657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e95e-c166-4e71-9458-d6cdd6a23a34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:18.434341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1de73-c500-46ed-b779-b4c2473b6db6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:18.463429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881e95e-c166-4e71-9458-d6cdd6a23a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d881e95e-c166-4e71-9458-d6cdd6a23a34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:18.479439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:18.480406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:18.481182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 140/276] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:18.485993 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affb49-efb8-4588-bc6c-ca2a6e31ca63 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:18.491386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affb49-efb8-4588-bc6c-ca2a6e31ca63 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:18.491753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affb49-efb8-4588-bc6c-ca2a6e31ca63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:18.512062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d0f6e-b1e0-45b8-9d5a-b261564b2f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:18.512786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0f6e-b1e0-45b8-9d5a-b261564b2f29 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:18.513073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0f6e-b1e0-45b8-9d5a-b261564b2f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:18.513349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0f6e-b1e0-45b8-9d5a-b261564b2f29 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:18.514164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d0f6e-b1e0-45b8-9d5a-b261564b2f29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:18.515838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d0f6e-b1e0-45b8-9d5a-b261564b2f29 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:18.533657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-53affb49-efb8-4588-bc6c-ca2a6e31ca63 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:18.535057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-53affb49-efb8-4588-bc6c-ca2a6e31ca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:18.579917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 137/277] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:43:18 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:43:18.580866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d0f6e-b1e0-45b8-9d5a-b261564b2f29 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:18.644319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:18.726151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 141/278] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:18.764094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affb49-efb8-4588-bc6c-ca2a6e31ca63 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:18.782518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:18.890560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d0f6e-b1e0-45b8-9d5a-b261564b2f29 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:18.967917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b743f-6296-4256-bb91-3805b4a779f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:18.969772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b743f-6296-4256-bb91-3805b4a779f5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:18.970543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b743f-6296-4256-bb91-3805b4a779f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:18.971053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b743f-6296-4256-bb91-3805b4a779f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:18.972595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b743f-6296-4256-bb91-3805b4a779f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:18.973151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b743f-6296-4256-bb91-3805b4a779f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:18.976828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b743f-6296-4256-bb91-3805b4a779f5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:19.001747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 138/279] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:19.004519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4acc-fff7-426f-a805-dbb6e16b0f62 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.005031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4acc-fff7-426f-a805-dbb6e16b0f62 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.005492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4acc-fff7-426f-a805-dbb6e16b0f62 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.008420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 139/280] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:19.009807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4acc-fff7-426f-a805-dbb6e16b0f62 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:19.023493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affb49-efb8-4588-bc6c-ca2a6e31ca63 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:19.095116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3a991-bc95-45e0-8d58-a20c74d79899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:19.096023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3a991-bc95-45e0-8d58-a20c74d79899 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.096405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3a991-bc95-45e0-8d58-a20c74d79899 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.096691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3a991-bc95-45e0-8d58-a20c74d79899 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.113544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3a991-bc95-45e0-8d58-a20c74d79899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c5c3a991-bc95-45e0-8d58-a20c74d79899 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:19.123086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:19.124527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:19.125697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 142/281] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:19.126978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ab742-1b22-4473-b745-bd56c0ac4a1a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.126978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ab742-1b22-4473-b745-bd56c0ac4a1a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.127154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ab742-1b22-4473-b745-bd56c0ac4a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.147653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e34ab742-1b22-4473-b745-bd56c0ac4a1a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:19.148837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e34ab742-1b22-4473-b745-bd56c0ac4a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:19.156907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:19.170167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4acc-fff7-426f-a805-dbb6e16b0f62 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:19.229621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:19.234472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 143/282] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:19.234900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94d52f-f713-4409-a0c4-bf9ae2668e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:19.236483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d52f-f713-4409-a0c4-bf9ae2668e10 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.237325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d52f-f713-4409-a0c4-bf9ae2668e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.237837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d52f-f713-4409-a0c4-bf9ae2668e10 None admin] PATH_INFO: `/v3/users/b5726a81f5594a1fb636cbcdc22767b7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.242538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ab742-1b22-4473-b745-bd56c0ac4a1a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:19.269844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94d52f-f713-4409-a0c4-bf9ae2668e10 None admin] RBAC: Authorizing `identity:get_user(user_id=b5726a81f5594a1fb636cbcdc22767b7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:19.271508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94d52f-f713-4409-a0c4-bf9ae2668e10 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:19.274013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 140/283] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:19 2022] GET /identity/v3/users/b5726a81f5594a1fb636cbcdc22767b7 => generated 293 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:19.281756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94d52f-f713-4409-a0c4-bf9ae2668e10 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:19.384960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ab742-1b22-4473-b745-bd56c0ac4a1a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:19.447631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9bdbb-b253-435c-9299-27ffef1ef01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:19.448632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9bdbb-b253-435c-9299-27ffef1ef01b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.449070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9bdbb-b253-435c-9299-27ffef1ef01b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.449171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94d52f-f713-4409-a0c4-bf9ae2668e10 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:19.449500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9bdbb-b253-435c-9299-27ffef1ef01b None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.450778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9bdbb-b253-435c-9299-27ffef1ef01b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:19.451265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9bdbb-b253-435c-9299-27ffef1ef01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:19.453991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9bdbb-b253-435c-9299-27ffef1ef01b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:19.474266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 144/284] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:19.475830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9bdbb-b253-435c-9299-27ffef1ef01b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:19.513491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991d040-9076-4cd9-9e8b-6ff76900aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:19.514454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d040-9076-4cd9-9e8b-6ff76900aba3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.514748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d040-9076-4cd9-9e8b-6ff76900aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.515020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d040-9076-4cd9-9e8b-6ff76900aba3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.529891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991d040-9076-4cd9-9e8b-6ff76900aba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2991d040-9076-4cd9-9e8b-6ff76900aba3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:19.539499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:19.540906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 141/285] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:19.543561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991d040-9076-4cd9-9e8b-6ff76900aba3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:19.560289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:19.597497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:19.661036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991d040-9076-4cd9-9e8b-6ff76900aba3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:19.680512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9bdbb-b253-435c-9299-27ffef1ef01b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:19.701042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143661a-bcba-4a97-a3b5-e7eccc6f4286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:19.702117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143661a-bcba-4a97-a3b5-e7eccc6f4286 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.702579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143661a-bcba-4a97-a3b5-e7eccc6f4286 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.702911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143661a-bcba-4a97-a3b5-e7eccc6f4286 None admin] PATH_INFO: `/v3/users/aedbc4e63aff435599840c5276334ed1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.704597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143661a-bcba-4a97-a3b5-e7eccc6f4286 None admin] RBAC: Authorizing `identity:get_user(user_id=aedbc4e63aff435599840c5276334ed1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:19.706290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143661a-bcba-4a97-a3b5-e7eccc6f4286 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:19.713439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 142/286] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:19 2022] GET /identity/v3/users/aedbc4e63aff435599840c5276334ed1 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:19.714690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143661a-bcba-4a97-a3b5-e7eccc6f4286 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:19.738142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3fddc-58ae-451e-91b5-d9a9fc13d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:19.739792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3fddc-58ae-451e-91b5-d9a9fc13d3bb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.740643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3fddc-58ae-451e-91b5-d9a9fc13d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.741436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3fddc-58ae-451e-91b5-d9a9fc13d3bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.742653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3fddc-58ae-451e-91b5-d9a9fc13d3bb None admin] RBAC: Adding query filter params (role.id=3d852826ac0a4f09b618a220333f2897, user.id=b5726a81f5594a1fb636cbcdc22767b7, scope.system=all) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:19.743198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3fddc-58ae-451e-91b5-d9a9fc13d3bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:19.745672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3fddc-58ae-451e-91b5-d9a9fc13d3bb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:19.755750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 145/287] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 17 12:43:19 2022] GET /identity/v3/role_assignments?user.id=b5726a81f5594a1fb636cbcdc22767b7&scope.system=all&role.id=3d852826ac0a4f09b618a220333f2897 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:19.757469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3fddc-58ae-451e-91b5-d9a9fc13d3bb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:19.826175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:19.870952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143661a-bcba-4a97-a3b5-e7eccc6f4286 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:19.924743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3fddc-58ae-451e-91b5-d9a9fc13d3bb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:19.947024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8f236-949c-406a-9a93-7059c2d594c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:19.947814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8f236-949c-406a-9a93-7059c2d594c9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.948079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8f236-949c-406a-9a93-7059c2d594c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.948356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8f236-949c-406a-9a93-7059c2d594c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.949249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8f236-949c-406a-9a93-7059c2d594c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:19.949912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8f236-949c-406a-9a93-7059c2d594c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:19.951223 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8f236-949c-406a-9a93-7059c2d594c9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:19.962776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:19.971376 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 143/288] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:19.971747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564badb-2d8e-47ef-b5c1-a1bf7f30eed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:19.972949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564badb-2d8e-47ef-b5c1-a1bf7f30eed8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:19.973448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564badb-2d8e-47ef-b5c1-a1bf7f30eed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:19.973917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564badb-2d8e-47ef-b5c1-a1bf7f30eed8 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:19.975916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564badb-2d8e-47ef-b5c1-a1bf7f30eed8 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:19.978281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564badb-2d8e-47ef-b5c1-a1bf7f30eed8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:19.978570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8f236-949c-406a-9a93-7059c2d594c9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:19.981982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 146/289] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:19 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:19.995580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564badb-2d8e-47ef-b5c1-a1bf7f30eed8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:20.107642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8f236-949c-406a-9a93-7059c2d594c9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:20.147483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa470-8d2a-46f6-a99e-994e4bd19744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:20.148413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa470-8d2a-46f6-a99e-994e4bd19744 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:20.148686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa470-8d2a-46f6-a99e-994e4bd19744 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:20.148958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa470-8d2a-46f6-a99e-994e4bd19744 None admin] PATH_INFO: `/v3/users/d3794da05d5440d9b2c8bc371609dd43` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:20.150344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa470-8d2a-46f6-a99e-994e4bd19744 None admin] RBAC: Authorizing `identity:get_user(user_id=d3794da05d5440d9b2c8bc371609dd43)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:20.151909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa470-8d2a-46f6-a99e-994e4bd19744 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:20.153999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 144/290] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:19 2022] GET /identity/v3/users/d3794da05d5440d9b2c8bc371609dd43 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:20.163770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa470-8d2a-46f6-a99e-994e4bd19744 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:20.184632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:20.310580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564badb-2d8e-47ef-b5c1-a1bf7f30eed8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:20.433431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4701e2f-f91b-4f90-885d-76f691dec1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:20.435404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701e2f-f91b-4f90-885d-76f691dec1ca None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:20.435862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701e2f-f91b-4f90-885d-76f691dec1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:20.436360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701e2f-f91b-4f90-885d-76f691dec1ca None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/users/aedbc4e63aff435599840c5276334ed1/roles/443ff5b7485a44109a9411b445079892` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:20.440031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4701e2f-f91b-4f90-885d-76f691dec1ca None admin] RBAC: Authorizing `identity:create_grant(project_id=02114f3d5b0740a3bccbe7d0edb81236, user_id=aedbc4e63aff435599840c5276334ed1, role_id=443ff5b7485a44109a9411b445079892)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:20.443961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4701e2f-f91b-4f90-885d-76f691dec1ca None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:20.452711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa470-8d2a-46f6-a99e-994e4bd19744 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:20.486573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 147/291] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:43:19 2022] PUT /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/users/aedbc4e63aff435599840c5276334ed1/roles/443ff5b7485a44109a9411b445079892 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:43:20.565230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c10a13-096d-44a8-b708-4b430ab7c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:20.565832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c10a13-096d-44a8-b708-4b430ab7c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:20.566267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c10a13-096d-44a8-b708-4b430ab7c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:20.566663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c10a13-096d-44a8-b708-4b430ab7c8a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:20.670059 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c10a13-096d-44a8-b708-4b430ab7c8a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:20.671678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c10a13-096d-44a8-b708-4b430ab7c8a9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:20.690627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:20.819356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 145/292] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:20.827766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4701e2f-f91b-4f90-885d-76f691dec1ca None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:20.889636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:20.953525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4701e2f-f91b-4f90-885d-76f691dec1ca None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:20.997063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927a0c9-3aeb-491e-bffa-a36c6428262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:20.997995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a0c9-3aeb-491e-bffa-a36c6428262d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:20.998305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a0c9-3aeb-491e-bffa-a36c6428262d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:20.998640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927a0c9-3aeb-491e-bffa-a36c6428262d None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:20.999940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927a0c9-3aeb-491e-bffa-a36c6428262d None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:21.001601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927a0c9-3aeb-491e-bffa-a36c6428262d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:21.003417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 148/293] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:20 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:21.010378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c10a13-096d-44a8-b708-4b430ab7c8a9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:21.131910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c10a13-096d-44a8-b708-4b430ab7c8a9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:21.144088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:21.181949 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ee821-5111-4438-a6bc-2c9a5e264f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:21.182669 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ee821-5111-4438-a6bc-2c9a5e264f9a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:21.182958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ee821-5111-4438-a6bc-2c9a5e264f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:21.183289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ee821-5111-4438-a6bc-2c9a5e264f9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:21.184093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ee821-5111-4438-a6bc-2c9a5e264f9a None admin] RBAC: Adding query filter params (role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236, user.id=d3794da05d5440d9b2c8bc371609dd43) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:21.184428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ee821-5111-4438-a6bc-2c9a5e264f9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:21.185921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ee821-5111-4438-a6bc-2c9a5e264f9a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:21.193124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 146/294] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:21 2022] GET /identity/v3/role_assignments?user.id=d3794da05d5440d9b2c8bc371609dd43&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=3d852826ac0a4f09b618a220333f2897 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:21.677157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce5d84-2392-4992-9db1-de84a4e2d660 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:21.677667 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce5d84-2392-4992-9db1-de84a4e2d660 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:21.678054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce5d84-2392-4992-9db1-de84a4e2d660 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:21.680831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 149/295] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:21.687534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bcdc9-4ccc-4351-91eb-9eaf8b8fe193 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:21.688019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bcdc9-4ccc-4351-91eb-9eaf8b8fe193 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:21.688397 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bcdc9-4ccc-4351-91eb-9eaf8b8fe193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:21.723330 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b21bcdc9-4ccc-4351-91eb-9eaf8b8fe193 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:21.724707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b21bcdc9-4ccc-4351-91eb-9eaf8b8fe193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:21.779791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a6b1d-f67a-4c6a-9794-6ebda19ca758 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:21.780170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a6b1d-f67a-4c6a-9794-6ebda19ca758 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:21.780383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a6b1d-f67a-4c6a-9794-6ebda19ca758 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:21.782048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 150/296] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:21.788341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14805070-0eb4-4ebf-88e2-7c89504a4122 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:21.788680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14805070-0eb4-4ebf-88e2-7c89504a4122 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:21.788939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14805070-0eb4-4ebf-88e2-7c89504a4122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:21.810744 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-14805070-0eb4-4ebf-88e2-7c89504a4122 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:21.812030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-14805070-0eb4-4ebf-88e2-7c89504a4122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:21.835811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 147/297] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:21.863551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bcdc9-4ccc-4351-91eb-9eaf8b8fe193 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:21.916328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 151/298] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:21.940836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14805070-0eb4-4ebf-88e2-7c89504a4122 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:22.021537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bcdc9-4ccc-4351-91eb-9eaf8b8fe193 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:22.026149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:22.026509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:22.084195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c2a1-e1a9-427c-a290-b2d30be98d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:22.085648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c2a1-e1a9-427c-a290-b2d30be98d51 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:22.085936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c2a1-e1a9-427c-a290-b2d30be98d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:22.086258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c2a1-e1a9-427c-a290-b2d30be98d51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:22.087908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c2a1-e1a9-427c-a290-b2d30be98d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:22.090289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c2a1-e1a9-427c-a290-b2d30be98d51 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:22.092071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 148/299] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:22.092727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14805070-0eb4-4ebf-88e2-7c89504a4122 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:22.098643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c2a1-e1a9-427c-a290-b2d30be98d51 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:22.146004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a9a4-aa3b-4a96-8e07-2f80fd90da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:22.147499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a9a4-aa3b-4a96-8e07-2f80fd90da7e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:22.147997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a9a4-aa3b-4a96-8e07-2f80fd90da7e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:22.148600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a9a4-aa3b-4a96-8e07-2f80fd90da7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:22.164035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36a9a4-aa3b-4a96-8e07-2f80fd90da7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3e36a9a4-aa3b-4a96-8e07-2f80fd90da7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:22.173575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:22.174725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:22.175798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:22.184341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 152/300] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:22.186244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a9a4-aa3b-4a96-8e07-2f80fd90da7e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:22.270290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c2a1-e1a9-427c-a290-b2d30be98d51 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:22.323311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0dd5b-f4df-440a-912c-95116ad1b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:22.324407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0dd5b-f4df-440a-912c-95116ad1b524 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:22.324907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0dd5b-f4df-440a-912c-95116ad1b524 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:22.325430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0dd5b-f4df-440a-912c-95116ad1b524 None admin] PATH_INFO: `/v3/groups` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:22.326602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0dd5b-f4df-440a-912c-95116ad1b524 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:22.328905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0dd5b-f4df-440a-912c-95116ad1b524 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:22.331717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a9a4-aa3b-4a96-8e07-2f80fd90da7e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:22.349864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:22.362456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 149/301] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Jun 17 12:43:22 2022] POST /identity/v3/groups => generated 229 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:43:22.403089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380c642-e6e7-4535-88ec-523904d32b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:22.403799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380c642-e6e7-4535-88ec-523904d32b65 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:22.404079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380c642-e6e7-4535-88ec-523904d32b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:22.404349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380c642-e6e7-4535-88ec-523904d32b65 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:22.405121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380c642-e6e7-4535-88ec-523904d32b65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:22.405426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380c642-e6e7-4535-88ec-523904d32b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:22.407161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380c642-e6e7-4535-88ec-523904d32b65 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:22.419958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 153/302] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:22.426568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0dd5b-f4df-440a-912c-95116ad1b524 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:22.483105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:22.579554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0dd5b-f4df-440a-912c-95116ad1b524 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:22.636005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdf3fa-44ce-469c-91d6-e295e5c7d87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:22.637953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdf3fa-44ce-469c-91d6-e295e5c7d87c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:22.642049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdf3fa-44ce-469c-91d6-e295e5c7d87c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:22.642656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdf3fa-44ce-469c-91d6-e295e5c7d87c None admin] PATH_INFO: `/v3/users/ec0ad7f7688d41eab58a077c85a8b03d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:22.660450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdf3fa-44ce-469c-91d6-e295e5c7d87c None admin] RBAC: Authorizing `identity:get_user(user_id=ec0ad7f7688d41eab58a077c85a8b03d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:22.662512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdf3fa-44ce-469c-91d6-e295e5c7d87c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:22.666905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 150/303] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:22 2022] GET /identity/v3/users/ec0ad7f7688d41eab58a077c85a8b03d => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:22.675374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380c642-e6e7-4535-88ec-523904d32b65 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:22.759210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2439e41-c060-48d9-9fd8-620b32c2b838 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:22.759870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2439e41-c060-48d9-9fd8-620b32c2b838 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:22.760351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2439e41-c060-48d9-9fd8-620b32c2b838 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:22.762041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 151/304] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:22.767848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ad3c6-c687-45c9-9110-e6978b06333a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:22.768472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ad3c6-c687-45c9-9110-e6978b06333a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:22.768946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ad3c6-c687-45c9-9110-e6978b06333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:22.788779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a99ad3c6-c687-45c9-9110-e6978b06333a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:22.790430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a99ad3c6-c687-45c9-9110-e6978b06333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:22.848591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380c642-e6e7-4535-88ec-523904d32b65 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:22.879667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 152/305] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:22.905311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e271e8c-b4b4-46d1-9065-cdc01bdfa022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:22.906070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e271e8c-b4b4-46d1-9065-cdc01bdfa022 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:22.906390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e271e8c-b4b4-46d1-9065-cdc01bdfa022 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:22.906672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e271e8c-b4b4-46d1-9065-cdc01bdfa022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:22.907934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e271e8c-b4b4-46d1-9065-cdc01bdfa022 None admin] RBAC: Adding query filter params (role.id=443ff5b7485a44109a9411b445079892, user.id=ec0ad7f7688d41eab58a077c85a8b03d, scope.system=all) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:22.908255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e271e8c-b4b4-46d1-9065-cdc01bdfa022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:22.908942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ad3c6-c687-45c9-9110-e6978b06333a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:22.909868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e271e8c-b4b4-46d1-9065-cdc01bdfa022 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:22.921721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 154/306] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 17 12:43:22 2022] GET /identity/v3/role_assignments?user.id=ec0ad7f7688d41eab58a077c85a8b03d&scope.system=all&role.id=443ff5b7485a44109a9411b445079892 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:22.945419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:23.037705 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ad3c6-c687-45c9-9110-e6978b06333a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:23.083604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6587f85-2f84-4a95-b5e2-fddeb31cba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:23.084730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6587f85-2f84-4a95-b5e2-fddeb31cba12 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:23.085100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6587f85-2f84-4a95-b5e2-fddeb31cba12 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:23.085535 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6587f85-2f84-4a95-b5e2-fddeb31cba12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:23.102040 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6587f85-2f84-4a95-b5e2-fddeb31cba12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c6587f85-2f84-4a95-b5e2-fddeb31cba12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:23.113950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:23.115103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:23.116301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 153/307] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:23.122641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e271e8c-b4b4-46d1-9065-cdc01bdfa022 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:23.164050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:23.241032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e271e8c-b4b4-46d1-9065-cdc01bdfa022 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:23.281006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ff32e-d8b0-44d9-b89f-933330d48926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:23.281730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ff32e-d8b0-44d9-b89f-933330d48926 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:23.282014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ff32e-d8b0-44d9-b89f-933330d48926 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:23.282328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ff32e-d8b0-44d9-b89f-933330d48926 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:23.283118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ff32e-d8b0-44d9-b89f-933330d48926 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:23.283427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ff32e-d8b0-44d9-b89f-933330d48926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:23.284929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ff32e-d8b0-44d9-b89f-933330d48926 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:23.296079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 155/308] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:23.301918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6587f85-2f84-4a95-b5e2-fddeb31cba12 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:23.366039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd394-885c-4b38-b839-aecf898d125e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:23.366270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd394-885c-4b38-b839-aecf898d125e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:23.366530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd394-885c-4b38-b839-aecf898d125e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:23.368436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 156/309] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:23.373775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04924-f90a-4716-b52b-ede14e09a40c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:23.374261 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04924-f90a-4716-b52b-ede14e09a40c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:23.374886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04924-f90a-4716-b52b-ede14e09a40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:23.399956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-32c04924-f90a-4716-b52b-ede14e09a40c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:23.400887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-32c04924-f90a-4716-b52b-ede14e09a40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:23.415867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:23.437198 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6587f85-2f84-4a95-b5e2-fddeb31cba12 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:23.474697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aeabd-29a2-4aa6-8402-3919ee4179e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:23.476141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aeabd-29a2-4aa6-8402-3919ee4179e5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:23.476621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aeabd-29a2-4aa6-8402-3919ee4179e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:23.477097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aeabd-29a2-4aa6-8402-3919ee4179e5 None admin] PATH_INFO: `/v3/users/b5726a81f5594a1fb636cbcdc22767b7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:23.483293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 157/310] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:23.483475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aeabd-29a2-4aa6-8402-3919ee4179e5 None admin] RBAC: Authorizing `identity:get_user(user_id=b5726a81f5594a1fb636cbcdc22767b7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:23.483475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aeabd-29a2-4aa6-8402-3919ee4179e5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:23.483475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 154/311] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:23 2022] GET /identity/v3/users/b5726a81f5594a1fb636cbcdc22767b7 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:23.489021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04924-f90a-4716-b52b-ede14e09a40c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:23.502463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aeabd-29a2-4aa6-8402-3919ee4179e5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:23.518842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:23.595680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04924-f90a-4716-b52b-ede14e09a40c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:23.620151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aeabd-29a2-4aa6-8402-3919ee4179e5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:23.632421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edd566-6c5c-453a-a3f1-93217f4e45fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:23.633382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd566-6c5c-453a-a3f1-93217f4e45fd None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:23.633668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd566-6c5c-453a-a3f1-93217f4e45fd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:23.633946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd566-6c5c-453a-a3f1-93217f4e45fd None admin] PATH_INFO: `/v3/system/users/b5726a81f5594a1fb636cbcdc22767b7/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:23.635650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edd566-6c5c-453a-a3f1-93217f4e45fd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b5726a81f5594a1fb636cbcdc22767b7, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:23.637084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edd566-6c5c-453a-a3f1-93217f4e45fd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:23.650729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 158/312] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Jun 17 12:43:23 2022] PUT /identity/v3/system/users/b5726a81f5594a1fb636cbcdc22767b7/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:23.670527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafef89-9002-4888-9200-3ab3095cb0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:23.671832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafef89-9002-4888-9200-3ab3095cb0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:23.672384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafef89-9002-4888-9200-3ab3095cb0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:23.672875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafef89-9002-4888-9200-3ab3095cb0a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:23.686873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafef89-9002-4888-9200-3ab3095cb0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-afafef89-9002-4888-9200-3ab3095cb0a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:23.696138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:23.697089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:23.697885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:23.700759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 155/313] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:23.706888 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edd566-6c5c-453a-a3f1-93217f4e45fd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:23.820888 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:23.836285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edd566-6c5c-453a-a3f1-93217f4e45fd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:23.880317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98d3cb-134b-4f1c-908a-91b29a3daf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:23.881445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98d3cb-134b-4f1c-908a-91b29a3daf2d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:23.881944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98d3cb-134b-4f1c-908a-91b29a3daf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:23.882468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98d3cb-134b-4f1c-908a-91b29a3daf2d None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:23.883445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98d3cb-134b-4f1c-908a-91b29a3daf2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:23.883998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98d3cb-134b-4f1c-908a-91b29a3daf2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:23.885444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98d3cb-134b-4f1c-908a-91b29a3daf2d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:23.895008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 159/314] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:23.901268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafef89-9002-4888-9200-3ab3095cb0a1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:23.918853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:24.022878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafef89-9002-4888-9200-3ab3095cb0a1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:24.058880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca725-61cb-4157-baab-f07402ee1bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:24.059793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca725-61cb-4157-baab-f07402ee1bbc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:24.060079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca725-61cb-4157-baab-f07402ee1bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:24.060358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca725-61cb-4157-baab-f07402ee1bbc None admin] PATH_INFO: `/v3/users/aedbc4e63aff435599840c5276334ed1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:24.061586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ca725-61cb-4157-baab-f07402ee1bbc None admin] RBAC: Authorizing `identity:get_user(user_id=aedbc4e63aff435599840c5276334ed1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:24.063115 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ca725-61cb-4157-baab-f07402ee1bbc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:24.065141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 156/315] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:23 2022] GET /identity/v3/users/aedbc4e63aff435599840c5276334ed1 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:24.070947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98d3cb-134b-4f1c-908a-91b29a3daf2d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:24.196934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98d3cb-134b-4f1c-908a-91b29a3daf2d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:24.233238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca3730-d73a-46a7-89ed-10f935304621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:24.233907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca3730-d73a-46a7-89ed-10f935304621 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:24.234231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca3730-d73a-46a7-89ed-10f935304621 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:24.234505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca3730-d73a-46a7-89ed-10f935304621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:24.257348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:24.308220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca3730-d73a-46a7-89ed-10f935304621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:24.308220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca3730-d73a-46a7-89ed-10f935304621 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:24.416906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 160/316] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:24.422656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca725-61cb-4157-baab-f07402ee1bbc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:24.511074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:24.535342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca725-61cb-4157-baab-f07402ee1bbc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:24.572930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f278344-1a63-4fc9-af48-6866221c91fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:24.573891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278344-1a63-4fc9-af48-6866221c91fd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:24.574229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278344-1a63-4fc9-af48-6866221c91fd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:24.574510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278344-1a63-4fc9-af48-6866221c91fd None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:24.575776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f278344-1a63-4fc9-af48-6866221c91fd None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:24.577263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f278344-1a63-4fc9-af48-6866221c91fd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:24.579433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 157/317] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:24 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:24.586856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca3730-d73a-46a7-89ed-10f935304621 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:24.643858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:24.700118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca3730-d73a-46a7-89ed-10f935304621 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:24.735560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb3f80-2958-46ec-ac29-803a562e554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:24.736313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb3f80-2958-46ec-ac29-803a562e554c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:24.736594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb3f80-2958-46ec-ac29-803a562e554c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:24.737208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb3f80-2958-46ec-ac29-803a562e554c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:24.738054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb3f80-2958-46ec-ac29-803a562e554c None admin] RBAC: Adding query filter params (role.id=443ff5b7485a44109a9411b445079892, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236, user.id=aedbc4e63aff435599840c5276334ed1) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:24.738395 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb3f80-2958-46ec-ac29-803a562e554c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:24.739918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb3f80-2958-46ec-ac29-803a562e554c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:24.747352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 161/318] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:24 2022] GET /identity/v3/role_assignments?user.id=aedbc4e63aff435599840c5276334ed1&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=443ff5b7485a44109a9411b445079892 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:24.857502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d20a9-cf35-4a01-967c-efcfa47eed6b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:24.857713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d20a9-cf35-4a01-967c-efcfa47eed6b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:24.857976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d20a9-cf35-4a01-967c-efcfa47eed6b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:24.859796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 158/319] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:24.866047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f71f9-70ef-400d-bf84-1008f9b941be None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:24.866381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f71f9-70ef-400d-bf84-1008f9b941be None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:24.866599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f71f9-70ef-400d-bf84-1008f9b941be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:24.891108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d48f71f9-70ef-400d-bf84-1008f9b941be None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:24.892915 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d48f71f9-70ef-400d-bf84-1008f9b941be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:24.974168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 162/320] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:25.000975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d20a9-cf35-4a01-967c-efcfa47eed6b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:25.122547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d20a9-cf35-4a01-967c-efcfa47eed6b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:25.163698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f383f-0f3c-41a7-aa6b-62e089d9e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:25.164557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f383f-0f3c-41a7-aa6b-62e089d9e122 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:25.164836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f383f-0f3c-41a7-aa6b-62e089d9e122 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:25.165116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f383f-0f3c-41a7-aa6b-62e089d9e122 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:25.166499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f383f-0f3c-41a7-aa6b-62e089d9e122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:25.168217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f383f-0f3c-41a7-aa6b-62e089d9e122 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:25.175528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 159/321] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:25.177044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f71f9-70ef-400d-bf84-1008f9b941be None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:25.227844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee67e5-39f4-4b13-8b35-ed40420e5590 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:25.228121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee67e5-39f4-4b13-8b35-ed40420e5590 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:25.228402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee67e5-39f4-4b13-8b35-ed40420e5590 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:25.229951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 160/322] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:25.231283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:25.235079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71892f95-c535-4e82-be81-eeeaf97497ec None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:25.235357 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71892f95-c535-4e82-be81-eeeaf97497ec None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:25.235623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71892f95-c535-4e82-be81-eeeaf97497ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:25.252905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-71892f95-c535-4e82-be81-eeeaf97497ec None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:25.254118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-71892f95-c535-4e82-be81-eeeaf97497ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:25.262298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:25.293506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f71f9-70ef-400d-bf84-1008f9b941be None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:25.333989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332af10-26d2-4f24-95bc-3c9b79dee184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:25.334693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332af10-26d2-4f24-95bc-3c9b79dee184 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:25.335108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 161/323] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:25.338309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332af10-26d2-4f24-95bc-3c9b79dee184 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:25.338826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332af10-26d2-4f24-95bc-3c9b79dee184 None admin] PATH_INFO: `/v3/groups` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:25.339560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332af10-26d2-4f24-95bc-3c9b79dee184 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:25.341095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332af10-26d2-4f24-95bc-3c9b79dee184 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:25.358437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71892f95-c535-4e82-be81-eeeaf97497ec None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:25.366186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 163/324] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Jun 17 12:43:25 2022] POST /identity/v3/groups => generated 226 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:43:25.472666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71892f95-c535-4e82-be81-eeeaf97497ec None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:25.514925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d717c-c761-472e-ad82-eb3ccb0e75ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:25.515791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d717c-c761-472e-ad82-eb3ccb0e75ec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:25.516075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d717c-c761-472e-ad82-eb3ccb0e75ec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:25.516349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d717c-c761-472e-ad82-eb3ccb0e75ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:25.529693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d717c-c761-472e-ad82-eb3ccb0e75ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-831d717c-c761-472e-ad82-eb3ccb0e75ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:25.539684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:25.540631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:25.541421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:25.546722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 162/325] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:25.548061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332af10-26d2-4f24-95bc-3c9b79dee184 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:25.670916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332af10-26d2-4f24-95bc-3c9b79dee184 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:25.680479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:25.712173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda4e0c-9fdb-4e1d-8265-d34884d47574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:25.713096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4e0c-9fdb-4e1d-8265-d34884d47574 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:25.713534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4e0c-9fdb-4e1d-8265-d34884d47574 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:25.713964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4e0c-9fdb-4e1d-8265-d34884d47574 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:25.715348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda4e0c-9fdb-4e1d-8265-d34884d47574 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:25.715814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda4e0c-9fdb-4e1d-8265-d34884d47574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:25.718229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda4e0c-9fdb-4e1d-8265-d34884d47574 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:25.728580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 164/326] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:25.734503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d717c-c761-472e-ad82-eb3ccb0e75ec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:25.738803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:25.850494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d717c-c761-472e-ad82-eb3ccb0e75ec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:25.894106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230af446-51ff-4b02-8c77-560a6e96113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:25.895038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230af446-51ff-4b02-8c77-560a6e96113a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:25.895321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230af446-51ff-4b02-8c77-560a6e96113a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:25.895601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230af446-51ff-4b02-8c77-560a6e96113a None admin] PATH_INFO: `/v3/users/ec0ad7f7688d41eab58a077c85a8b03d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:25.897691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230af446-51ff-4b02-8c77-560a6e96113a None admin] RBAC: Authorizing `identity:get_user(user_id=ec0ad7f7688d41eab58a077c85a8b03d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:25.899232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230af446-51ff-4b02-8c77-560a6e96113a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:25.901199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 163/327] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:25 2022] GET /identity/v3/users/ec0ad7f7688d41eab58a077c85a8b03d => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:25.907281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda4e0c-9fdb-4e1d-8265-d34884d47574 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:26.031077 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f7a97-ebc3-4804-83e1-4bfa64811035 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:26.031263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f7a97-ebc3-4804-83e1-4bfa64811035 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:26.031558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f7a97-ebc3-4804-83e1-4bfa64811035 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:26.033102 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 164/328] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:26.041712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875e52-d787-46e9-994b-00f1f1221214 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:26.042106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875e52-d787-46e9-994b-00f1f1221214 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:26.042452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04875e52-d787-46e9-994b-00f1f1221214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:26.058742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda4e0c-9fdb-4e1d-8265-d34884d47574 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:26.063259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-04875e52-d787-46e9-994b-00f1f1221214 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:26.064757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-04875e52-d787-46e9-994b-00f1f1221214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:26.105724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf1500-7734-4141-bbc5-3e14a9eaf2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:26.106783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf1500-7734-4141-bbc5-3e14a9eaf2b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:26.107156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf1500-7734-4141-bbc5-3e14a9eaf2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:26.107497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf1500-7734-4141-bbc5-3e14a9eaf2b9 None admin] PATH_INFO: `/v3/system/users/ec0ad7f7688d41eab58a077c85a8b03d/roles/443ff5b7485a44109a9411b445079892` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:26.111195 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf1500-7734-4141-bbc5-3e14a9eaf2b9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec0ad7f7688d41eab58a077c85a8b03d, role_id=443ff5b7485a44109a9411b445079892)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:26.113190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf1500-7734-4141-bbc5-3e14a9eaf2b9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:26.125823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 165/329] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Jun 17 12:43:25 2022] PUT /identity/v3/system/users/ec0ad7f7688d41eab58a077c85a8b03d/roles/443ff5b7485a44109a9411b445079892 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:26.167319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:26.172784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 165/330] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:26.197209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf1500-7734-4141-bbc5-3e14a9eaf2b9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:26.248315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:26.320847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf1500-7734-4141-bbc5-3e14a9eaf2b9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:26.362662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee0c7c-a6ed-4160-9db7-b94e23cda6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:26.363508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee0c7c-a6ed-4160-9db7-b94e23cda6fd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:26.363785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee0c7c-a6ed-4160-9db7-b94e23cda6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:26.364063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee0c7c-a6ed-4160-9db7-b94e23cda6fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:26.376545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee0c7c-a6ed-4160-9db7-b94e23cda6fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-adee0c7c-a6ed-4160-9db7-b94e23cda6fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:26.385754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:26.386843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:26.387694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 166/331] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:26.394768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04875e52-d787-46e9-994b-00f1f1221214 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:26.507917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04875e52-d787-46e9-994b-00f1f1221214 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:26.545522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac761129-123e-41d3-93a2-c930874e6327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:26.546273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac761129-123e-41d3-93a2-c930874e6327 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:26.546566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac761129-123e-41d3-93a2-c930874e6327 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:26.546844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac761129-123e-41d3-93a2-c930874e6327 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:26.547614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac761129-123e-41d3-93a2-c930874e6327 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:26.547921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac761129-123e-41d3-93a2-c930874e6327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:26.549347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac761129-123e-41d3-93a2-c930874e6327 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:26.560260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 166/332] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:26.566112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee0c7c-a6ed-4160-9db7-b94e23cda6fd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:26.678542 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:26.683017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee0c7c-a6ed-4160-9db7-b94e23cda6fd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:26.724609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aff00b-9623-4e9c-8a3a-a2630134dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:26.725549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aff00b-9623-4e9c-8a3a-a2630134dba1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:26.725822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aff00b-9623-4e9c-8a3a-a2630134dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:26.726115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aff00b-9623-4e9c-8a3a-a2630134dba1 None admin] PATH_INFO: `/v3/users/b5726a81f5594a1fb636cbcdc22767b7` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:26.727493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aff00b-9623-4e9c-8a3a-a2630134dba1 None admin] RBAC: Authorizing `identity:get_user(user_id=b5726a81f5594a1fb636cbcdc22767b7)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:26.729004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aff00b-9623-4e9c-8a3a-a2630134dba1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:26.731077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 167/333] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:26 2022] GET /identity/v3/users/b5726a81f5594a1fb636cbcdc22767b7 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:26.737597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac761129-123e-41d3-93a2-c930874e6327 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:26.812685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:26.858875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac761129-123e-41d3-93a2-c930874e6327 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:26.897088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa3d02-95e1-4a2e-a77a-deeccc8fb532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:26.897771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa3d02-95e1-4a2e-a77a-deeccc8fb532 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:26.898055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa3d02-95e1-4a2e-a77a-deeccc8fb532 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:26.898366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa3d02-95e1-4a2e-a77a-deeccc8fb532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:26.899217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa3d02-95e1-4a2e-a77a-deeccc8fb532 None admin] RBAC: Adding query filter params (role.id=3d852826ac0a4f09b618a220333f2897, user.id=b5726a81f5594a1fb636cbcdc22767b7, scope.system=all) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:26.899531 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa3d02-95e1-4a2e-a77a-deeccc8fb532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:26.901123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa3d02-95e1-4a2e-a77a-deeccc8fb532 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:26.914785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 167/334] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 17 12:43:26 2022] GET /identity/v3/role_assignments?user.id=b5726a81f5594a1fb636cbcdc22767b7&scope.system=all&role.id=3d852826ac0a4f09b618a220333f2897 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:28.023769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632467a-8383-4e60-bd23-0a9247cedec2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:28.024841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632467a-8383-4e60-bd23-0a9247cedec2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:28.025334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632467a-8383-4e60-bd23-0a9247cedec2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:28.027282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 168/335] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:28.033461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58ae12-c421-49f6-90eb-5ba370229052 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:28.034133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58ae12-c421-49f6-90eb-5ba370229052 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:28.034133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58ae12-c421-49f6-90eb-5ba370229052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:28.056835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3d58ae12-c421-49f6-90eb-5ba370229052 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:28.058048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3d58ae12-c421-49f6-90eb-5ba370229052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:28.166527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 168/336] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:28.191115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632467a-8383-4e60-bd23-0a9247cedec2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:28.331101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632467a-8383-4e60-bd23-0a9247cedec2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:28.390940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693958d7-8904-4b92-ba18-1bdd8b3399e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:28.391817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693958d7-8904-4b92-ba18-1bdd8b3399e2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:28.392099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693958d7-8904-4b92-ba18-1bdd8b3399e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:28.392374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693958d7-8904-4b92-ba18-1bdd8b3399e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:28.415270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693958d7-8904-4b92-ba18-1bdd8b3399e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-693958d7-8904-4b92-ba18-1bdd8b3399e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:28.423804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:28.424752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:28.425584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 169/337] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:28.432301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58ae12-c421-49f6-90eb-5ba370229052 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:28.522174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffb71d-011e-4461-b023-4fa2105f83f9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:28.522571 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffb71d-011e-4461-b023-4fa2105f83f9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:28.522736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:28.522855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffb71d-011e-4461-b023-4fa2105f83f9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:28.524409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 170/338] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:28.531671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e621ba0-877f-45d2-9b3d-6601b7e57db8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:28.532047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e621ba0-877f-45d2-9b3d-6601b7e57db8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:28.532200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e621ba0-877f-45d2-9b3d-6601b7e57db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:28.570250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5e621ba0-877f-45d2-9b3d-6601b7e57db8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:28.571392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5e621ba0-877f-45d2-9b3d-6601b7e57db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:28.588134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58ae12-c421-49f6-90eb-5ba370229052 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:28.618497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:28.631396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7d137-93aa-43c5-9cf0-357ea3580a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:28.631820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d137-93aa-43c5-9cf0-357ea3580a74 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:28.632114 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d137-93aa-43c5-9cf0-357ea3580a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:28.632392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d137-93aa-43c5-9cf0-357ea3580a74 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:28.633167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7d137-93aa-43c5-9cf0-357ea3580a74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:28.633477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7d137-93aa-43c5-9cf0-357ea3580a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:28.634933 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7d137-93aa-43c5-9cf0-357ea3580a74 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:28.650469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 169/339] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:28.667956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7d137-93aa-43c5-9cf0-357ea3580a74 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:28.761215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 171/340] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:28.808115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e621ba0-877f-45d2-9b3d-6601b7e57db8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:28.853857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7d137-93aa-43c5-9cf0-357ea3580a74 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:28.890472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:28.920820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c043f21-5b5a-42f7-8522-072c3874c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:28.921504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c043f21-5b5a-42f7-8522-072c3874c760 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:28.921854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c043f21-5b5a-42f7-8522-072c3874c760 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:28.922230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c043f21-5b5a-42f7-8522-072c3874c760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:29.005521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c043f21-5b5a-42f7-8522-072c3874c760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:29.007380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c043f21-5b5a-42f7-8522-072c3874c760 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:29.117945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 170/341] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 12:43:29.120229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e621ba0-877f-45d2-9b3d-6601b7e57db8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:29.124451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c043f21-5b5a-42f7-8522-072c3874c760 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:29.142509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:29.239750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c043f21-5b5a-42f7-8522-072c3874c760 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:29.254080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d292a3f-4e0b-4d8d-90b5-417249f54cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:29.255020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d292a3f-4e0b-4d8d-90b5-417249f54cef None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:29.255302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d292a3f-4e0b-4d8d-90b5-417249f54cef None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:29.255605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d292a3f-4e0b-4d8d-90b5-417249f54cef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:29.279409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68f98-6886-4aab-9a05-e12deaed51f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:29.280563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68f98-6886-4aab-9a05-e12deaed51f7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:29.280986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68f98-6886-4aab-9a05-e12deaed51f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:29.281398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68f98-6886-4aab-9a05-e12deaed51f7 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:29.282792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad68f98-6886-4aab-9a05-e12deaed51f7 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:29.284479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad68f98-6886-4aab-9a05-e12deaed51f7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:29.286821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 171/342] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:29 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:29.293307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68f98-6886-4aab-9a05-e12deaed51f7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:29.298764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d292a3f-4e0b-4d8d-90b5-417249f54cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9d292a3f-4e0b-4d8d-90b5-417249f54cef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:29.312883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:29.313956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:29.316758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:29.319149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 172/343] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 512 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:29.327145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d292a3f-4e0b-4d8d-90b5-417249f54cef None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:29.354478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:29.422495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:29.443436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68f98-6886-4aab-9a05-e12deaed51f7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:29.499015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d292a3f-4e0b-4d8d-90b5-417249f54cef None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:29.523113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367f3a2-19bf-4523-98f7-77c1af973ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:29.524055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367f3a2-19bf-4523-98f7-77c1af973ecd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:29.524344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367f3a2-19bf-4523-98f7-77c1af973ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:29.524625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367f3a2-19bf-4523-98f7-77c1af973ecd None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:29.541700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367f3a2-19bf-4523-98f7-77c1af973ecd None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:29.543353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367f3a2-19bf-4523-98f7-77c1af973ecd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:29.546076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 172/344] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:29 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:29.553815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367f3a2-19bf-4523-98f7-77c1af973ecd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:29.554001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13083b-3b32-483f-943a-9936476083d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:29.554996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13083b-3b32-483f-943a-9936476083d4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:29.555302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13083b-3b32-483f-943a-9936476083d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:29.555576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13083b-3b32-483f-943a-9936476083d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:29.556478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13083b-3b32-483f-943a-9936476083d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:29.556931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13083b-3b32-483f-943a-9936476083d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:29.558474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13083b-3b32-483f-943a-9936476083d4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:29.572820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 173/345] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:29.579397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13083b-3b32-483f-943a-9936476083d4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:29.680540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367f3a2-19bf-4523-98f7-77c1af973ecd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:29.703692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:29.723251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019dfc4-1443-4d5c-b93c-4bfbb77100dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:29.724044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019dfc4-1443-4d5c-b93c-4bfbb77100dc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:29.724396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019dfc4-1443-4d5c-b93c-4bfbb77100dc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:29.724681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019dfc4-1443-4d5c-b93c-4bfbb77100dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:29.725540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019dfc4-1443-4d5c-b93c-4bfbb77100dc None admin] RBAC: Adding query filter params (group.id=09c652bb9eb647a893a2f90d23bf1dfe, role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=255f1d6d50524cb9927e19bc3f010eae) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:29.725858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019dfc4-1443-4d5c-b93c-4bfbb77100dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:29.727539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019dfc4-1443-4d5c-b93c-4bfbb77100dc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:29.733922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13083b-3b32-483f-943a-9936476083d4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:29.735361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 173/346] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:29 2022] GET /identity/v3/role_assignments?group.id=09c652bb9eb647a893a2f90d23bf1dfe&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=3d852826ac0a4f09b618a220333f2897 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:29.767477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f235-535a-4ae0-8623-3df43dcb2405 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:29.767829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f235-535a-4ae0-8623-3df43dcb2405 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:29.768047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f235-535a-4ae0-8623-3df43dcb2405 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:29.769720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 174/347] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:29.785183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb275fe4-d1fb-42ab-bcbb-b8d6dafb4d50 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:29.785493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb275fe4-d1fb-42ab-bcbb-b8d6dafb4d50 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:29.785736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb275fe4-d1fb-42ab-bcbb-b8d6dafb4d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:29.801967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3c062-dfe4-418d-b42a-db12ce73b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:29.802747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3c062-dfe4-418d-b42a-db12ce73b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:29.803031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3c062-dfe4-418d-b42a-db12ce73b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:29.803308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3c062-dfe4-418d-b42a-db12ce73b6b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:29.811457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-eb275fe4-d1fb-42ab-bcbb-b8d6dafb4d50 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:29.812659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb275fe4-d1fb-42ab-bcbb-b8d6dafb4d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:29.823889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:29.917752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3c062-dfe4-418d-b42a-db12ce73b6b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:29.919352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3c062-dfe4-418d-b42a-db12ce73b6b6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:29.978568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 175/348] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:30.011193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:30.025665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb275fe4-d1fb-42ab-bcbb-b8d6dafb4d50 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:30.044447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 174/349] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:30.050389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3c062-dfe4-418d-b42a-db12ce73b6b6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:30.175524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3c062-dfe4-418d-b42a-db12ce73b6b6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:30.205451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb275fe4-d1fb-42ab-bcbb-b8d6dafb4d50 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:30.246523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7098ec-8459-4402-a903-d3f505fd928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:30.247407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7098ec-8459-4402-a903-d3f505fd928c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:30.247685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7098ec-8459-4402-a903-d3f505fd928c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:30.247957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7098ec-8459-4402-a903-d3f505fd928c None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:30.254121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7098ec-8459-4402-a903-d3f505fd928c None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:30.254121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7098ec-8459-4402-a903-d3f505fd928c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:30.258666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 175/350] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:30 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:30.270132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7098ec-8459-4402-a903-d3f505fd928c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:30.274754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741477a-4644-42a7-8148-8a4dfb9004b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:30.276013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741477a-4644-42a7-8148-8a4dfb9004b1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:30.276542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741477a-4644-42a7-8148-8a4dfb9004b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:30.277010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741477a-4644-42a7-8148-8a4dfb9004b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:30.285831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:30.300711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741477a-4644-42a7-8148-8a4dfb9004b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a741477a-4644-42a7-8148-8a4dfb9004b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:30.310565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:30.311417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:30.312242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:30.319313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 176/351] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:30.324927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741477a-4644-42a7-8148-8a4dfb9004b1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:30.355573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:30.465208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7098ec-8459-4402-a903-d3f505fd928c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:30.535421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741477a-4644-42a7-8148-8a4dfb9004b1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:30.542203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0eaf0-585e-4813-97c0-e1d41d86ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:30.543131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0eaf0-585e-4813-97c0-e1d41d86ef7b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:30.543414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0eaf0-585e-4813-97c0-e1d41d86ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:30.543689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0eaf0-585e-4813-97c0-e1d41d86ef7b None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:30.545095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0eaf0-585e-4813-97c0-e1d41d86ef7b None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:30.546682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0eaf0-585e-4813-97c0-e1d41d86ef7b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:30.554125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 176/352] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:30 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:30.555852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640d07-94a0-4554-b784-4345af711288 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:30.556152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640d07-94a0-4554-b784-4345af711288 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:30.556415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640d07-94a0-4554-b784-4345af711288 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:30.565441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 177/353] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:30.566557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640d07-94a0-4554-b784-4345af711288 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:30.630553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4311b5-bd9f-49e0-825e-f9c2e698eb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:30.634965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4311b5-bd9f-49e0-825e-f9c2e698eb48 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:30.635253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4311b5-bd9f-49e0-825e-f9c2e698eb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:30.635529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4311b5-bd9f-49e0-825e-f9c2e698eb48 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:30.636316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4311b5-bd9f-49e0-825e-f9c2e698eb48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:30.636625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4311b5-bd9f-49e0-825e-f9c2e698eb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:30.638055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4311b5-bd9f-49e0-825e-f9c2e698eb48 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:30.655785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 177/354] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:30.657136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c6ca-6eb7-43e9-b55a-021c41e06392 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:30.657423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c6ca-6eb7-43e9-b55a-021c41e06392 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:30.657706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c6ca-6eb7-43e9-b55a-021c41e06392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:30.675547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-99e7c6ca-6eb7-43e9-b55a-021c41e06392 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:30.680644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-99e7c6ca-6eb7-43e9-b55a-021c41e06392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:30.724780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640d07-94a0-4554-b784-4345af711288 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:30.737456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:30.766264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:30.776640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e052051-f36c-475e-8830-5151215d2617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:30.777526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e052051-f36c-475e-8830-5151215d2617 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:30.777872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e052051-f36c-475e-8830-5151215d2617 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:30.778273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e052051-f36c-475e-8830-5151215d2617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:30.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e052051-f36c-475e-8830-5151215d2617 None admin] RBAC: Adding query filter params (group.id=09c652bb9eb647a893a2f90d23bf1dfe, role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=255f1d6d50524cb9927e19bc3f010eae) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:30.779643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e052051-f36c-475e-8830-5151215d2617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:30.781340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e052051-f36c-475e-8830-5151215d2617 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:30.781673 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 178/355] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:30.783311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa101f4f-d124-4cdc-8998-858c30902924 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:30.783607 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa101f4f-d124-4cdc-8998-858c30902924 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:30.784254 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa101f4f-d124-4cdc-8998-858c30902924 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:30.787083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 179/356] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:30.787888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa101f4f-d124-4cdc-8998-858c30902924 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:30.792836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 178/357] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:30 2022] GET /identity/v3/role_assignments?group.id=09c652bb9eb647a893a2f90d23bf1dfe&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=1a772cde30724b09b110b5dffecfd462 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:30.794211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5fda-6113-4cb7-8b27-52541c6d06ca None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:30.794502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5fda-6113-4cb7-8b27-52541c6d06ca None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:30.794779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5fda-6113-4cb7-8b27-52541c6d06ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:30.842123 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-cc3b5fda-6113-4cb7-8b27-52541c6d06ca None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:30.843381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cc3b5fda-6113-4cb7-8b27-52541c6d06ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:30.932947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 179/358] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:30.934131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b5fda-6113-4cb7-8b27-52541c6d06ca None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:30.998326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa101f4f-d124-4cdc-8998-858c30902924 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:31.040767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2eb00-d0cb-4fdb-9b74-bcc89c60f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:31.041653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2eb00-d0cb-4fdb-9b74-bcc89c60f2bf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.041962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2eb00-d0cb-4fdb-9b74-bcc89c60f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.042281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2eb00-d0cb-4fdb-9b74-bcc89c60f2bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.061780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b5fda-6113-4cb7-8b27-52541c6d06ca None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:31.074513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:31.122674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcdb9f-36df-4030-815e-d49c12da3a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:31.124552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcdb9f-36df-4030-815e-d49c12da3a42 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.124879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcdb9f-36df-4030-815e-d49c12da3a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.125350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcdb9f-36df-4030-815e-d49c12da3a42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.126187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:31.148084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2eb00-d0cb-4fdb-9b74-bcc89c60f2bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:31.149750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcdb9f-36df-4030-815e-d49c12da3a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:31.150191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2eb00-d0cb-4fdb-9b74-bcc89c60f2bf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-fbfcdb9f-36df-4030-815e-d49c12da3a42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:31.160601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:31.161992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:31.163375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 180/359] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:31.165320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397191e6-b2b3-4f44-ad47-364769f197f8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.165406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397191e6-b2b3-4f44-ad47-364769f197f8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.167605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397191e6-b2b3-4f44-ad47-364769f197f8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.167605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 181/360] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:31.168693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397191e6-b2b3-4f44-ad47-364769f197f8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:31.297263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 180/361] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:31.298213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2eb00-d0cb-4fdb-9b74-bcc89c60f2bf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:31.328764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397191e6-b2b3-4f44-ad47-364769f197f8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:31.381595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc37ae-cd59-499d-9710-bbdc783fbf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:31.382152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc37ae-cd59-499d-9710-bbdc783fbf31 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.382319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc37ae-cd59-499d-9710-bbdc783fbf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.382784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc37ae-cd59-499d-9710-bbdc783fbf31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.406811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc37ae-cd59-499d-9710-bbdc783fbf31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-fafc37ae-cd59-499d-9710-bbdc783fbf31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:31.416677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:31.417681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:31.418546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:31.421178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 182/362] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:31.422717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e659bc-9a8b-4f65-9944-f19945c78516 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.423235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e659bc-9a8b-4f65-9944-f19945c78516 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.423706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e659bc-9a8b-4f65-9944-f19945c78516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.439202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:31.447094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b5e659bc-9a8b-4f65-9944-f19945c78516 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:31.448700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b5e659bc-9a8b-4f65-9944-f19945c78516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:31.451865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2eb00-d0cb-4fdb-9b74-bcc89c60f2bf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:31.474655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:31.523958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383a4a-c53d-4ddf-aea3-d967560632e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:31.524666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383a4a-c53d-4ddf-aea3-d967560632e9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.524950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383a4a-c53d-4ddf-aea3-d967560632e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.525226 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383a4a-c53d-4ddf-aea3-d967560632e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.525995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383a4a-c53d-4ddf-aea3-d967560632e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:31.526342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383a4a-c53d-4ddf-aea3-d967560632e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:31.527828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383a4a-c53d-4ddf-aea3-d967560632e9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:31.538068 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 183/364] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:31.538860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e659bc-9a8b-4f65-9944-f19945c78516 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:31.540284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 181/364] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:31.541394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383a4a-c53d-4ddf-aea3-d967560632e9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:31.675706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383a4a-c53d-4ddf-aea3-d967560632e9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:31.696889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e659bc-9a8b-4f65-9944-f19945c78516 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:31.729611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588418-0121-45cb-9b77-e6fb9c6df773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:31.731014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588418-0121-45cb-9b77-e6fb9c6df773 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.731298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588418-0121-45cb-9b77-e6fb9c6df773 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.732471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588418-0121-45cb-9b77-e6fb9c6df773 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.733507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588418-0121-45cb-9b77-e6fb9c6df773 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:31.733829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588418-0121-45cb-9b77-e6fb9c6df773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:31.736414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588418-0121-45cb-9b77-e6fb9c6df773 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:31.749181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14faf14-eb95-460c-b5bd-83f807ca0b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:31.750319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14faf14-eb95-460c-b5bd-83f807ca0b9c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.750584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14faf14-eb95-460c-b5bd-83f807ca0b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.750864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14faf14-eb95-460c-b5bd-83f807ca0b9c None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.751117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 182/365] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:31.752293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14faf14-eb95-460c-b5bd-83f807ca0b9c None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:31.753474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588418-0121-45cb-9b77-e6fb9c6df773 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:31.753845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14faf14-eb95-460c-b5bd-83f807ca0b9c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:31.757490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 184/366] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:31 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:31.758247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14faf14-eb95-460c-b5bd-83f807ca0b9c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:31.783448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:31.799190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:31.915467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588418-0121-45cb-9b77-e6fb9c6df773 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:31.917678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14faf14-eb95-460c-b5bd-83f807ca0b9c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:31.974113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd64fe-8ac0-4fc5-957b-e092558f7ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:31.974799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd64fe-8ac0-4fc5-957b-e092558f7ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.975089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd64fe-8ac0-4fc5-957b-e092558f7ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.975474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd64fe-8ac0-4fc5-957b-e092558f7ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.975857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227491b-fd2c-40cf-b78b-eb4da6d07aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:31.976716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227491b-fd2c-40cf-b78b-eb4da6d07aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:31.977003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227491b-fd2c-40cf-b78b-eb4da6d07aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:31.977277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227491b-fd2c-40cf-b78b-eb4da6d07aa1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:31.993089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227491b-fd2c-40cf-b78b-eb4da6d07aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1227491b-fd2c-40cf-b78b-eb4da6d07aa1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:32.004444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:32.006703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 185/367] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:32.008579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227491b-fd2c-40cf-b78b-eb4da6d07aa1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:32.092353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd64fe-8ac0-4fc5-957b-e092558f7ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:32.095053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd64fe-8ac0-4fc5-957b-e092558f7ed6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:32.144200 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:32.144402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:32.186566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227491b-fd2c-40cf-b78b-eb4da6d07aa1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:32.239462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091c409-d168-487b-8a11-6f4f1950631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:32.241144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091c409-d168-487b-8a11-6f4f1950631b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:32.241938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091c409-d168-487b-8a11-6f4f1950631b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:32.242713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091c409-d168-487b-8a11-6f4f1950631b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:32.267565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 183/368] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:32.269325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd64fe-8ac0-4fc5-957b-e092558f7ed6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:32.337722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091c409-d168-487b-8a11-6f4f1950631b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:32.339324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091c409-d168-487b-8a11-6f4f1950631b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:32.414270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd64fe-8ac0-4fc5-957b-e092558f7ed6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:32.433692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:32.437836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:32.460682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf5182-3242-49a0-9820-fbcb70a34599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:32.461612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf5182-3242-49a0-9820-fbcb70a34599 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:32.461895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf5182-3242-49a0-9820-fbcb70a34599 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:32.462222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf5182-3242-49a0-9820-fbcb70a34599 None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:32.463548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf5182-3242-49a0-9820-fbcb70a34599 None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:32.465070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf5182-3242-49a0-9820-fbcb70a34599 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:32.466952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 184/369] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:32 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:32.467756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf5182-3242-49a0-9820-fbcb70a34599 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:32.469419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 186/370] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:32.470472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091c409-d168-487b-8a11-6f4f1950631b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:32.590958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf5182-3242-49a0-9820-fbcb70a34599 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:32.594462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091c409-d168-487b-8a11-6f4f1950631b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:32.650713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf36496-5796-4f2e-a4e9-a279388440d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:32.652473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf36496-5796-4f2e-a4e9-a279388440d3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:32.653110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf36496-5796-4f2e-a4e9-a279388440d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:32.653740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf36496-5796-4f2e-a4e9-a279388440d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:32.655713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf36496-5796-4f2e-a4e9-a279388440d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:32.656362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf36496-5796-4f2e-a4e9-a279388440d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:32.658426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf36496-5796-4f2e-a4e9-a279388440d3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:32.670869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 185/371] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:32.671967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf36496-5796-4f2e-a4e9-a279388440d3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:32.672270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc1db2-318c-4961-8106-614dc98af720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:32.673437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc1db2-318c-4961-8106-614dc98af720 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:32.673897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc1db2-318c-4961-8106-614dc98af720 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:32.679835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc1db2-318c-4961-8106-614dc98af720 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:32.679835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc1db2-318c-4961-8106-614dc98af720 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:32.680271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc1db2-318c-4961-8106-614dc98af720 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:32.683970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 187/372] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:32 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:32.683970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc1db2-318c-4961-8106-614dc98af720 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:32.761638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:32.764967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:32.856599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc1db2-318c-4961-8106-614dc98af720 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:32.856931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf36496-5796-4f2e-a4e9-a279388440d3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:32.920683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89952fc5-4b45-428f-89f5-38c347f67400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:32.920683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89952fc5-4b45-428f-89f5-38c347f67400 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:32.920683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89952fc5-4b45-428f-89f5-38c347f67400 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:32.920683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89952fc5-4b45-428f-89f5-38c347f67400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:32.921643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89952fc5-4b45-428f-89f5-38c347f67400 None admin] RBAC: Adding query filter params (group.id=09c652bb9eb647a893a2f90d23bf1dfe, role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:32.921971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89952fc5-4b45-428f-89f5-38c347f67400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:32.923586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89952fc5-4b45-428f-89f5-38c347f67400 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:32.929918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268f69c-f868-4b3a-8b4f-c20a28ce32a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:32.930970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268f69c-f868-4b3a-8b4f-c20a28ce32a0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:32.931637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268f69c-f868-4b3a-8b4f-c20a28ce32a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:32.931637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268f69c-f868-4b3a-8b4f-c20a28ce32a0 None admin] PATH_INFO: `/v3/projects/91e888714806438f834a0309a74fcb9e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:32.933107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 188/373] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:32 2022] GET /identity/v3/role_assignments?group.id=09c652bb9eb647a893a2f90d23bf1dfe&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=3d852826ac0a4f09b618a220333f2897 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:32.934550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0eb6a-2c20-45d4-b743-0f047745a07e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:32.934803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268f69c-f868-4b3a-8b4f-c20a28ce32a0 None admin] RBAC: Authorizing `identity:get_project(project_id=91e888714806438f834a0309a74fcb9e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:32.934901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0eb6a-2c20-45d4-b743-0f047745a07e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:32.935117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0eb6a-2c20-45d4-b743-0f047745a07e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:32.936755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 189/374] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:32.937148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268f69c-f868-4b3a-8b4f-c20a28ce32a0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:32.937553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0eb6a-2c20-45d4-b743-0f047745a07e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:32.939684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 186/375] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:32 2022] GET /identity/v3/projects/91e888714806438f834a0309a74fcb9e => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:32.940871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268f69c-f868-4b3a-8b4f-c20a28ce32a0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:33.116973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268f69c-f868-4b3a-8b4f-c20a28ce32a0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:33.123898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0eb6a-2c20-45d4-b743-0f047745a07e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:33.144246 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:33.150539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:33.179125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11af42-c6c8-4e9e-a504-e4df9582bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:33.180331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11af42-c6c8-4e9e-a504-e4df9582bd52 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.181122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11af42-c6c8-4e9e-a504-e4df9582bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.181832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11af42-c6c8-4e9e-a504-e4df9582bd52 None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.183517 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11af42-c6c8-4e9e-a504-e4df9582bd52 None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:33.185959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11af42-c6c8-4e9e-a504-e4df9582bd52 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:33.188080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4fab6-cf08-40b3-931e-563c3d8c5c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:33.188916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 187/376] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:32 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:33.189967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4fab6-cf08-40b3-931e-563c3d8c5c28 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.191808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4fab6-cf08-40b3-931e-563c3d8c5c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.191808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4fab6-cf08-40b3-931e-563c3d8c5c28 None admin] PATH_INFO: `/v3/users/ec0ad7f7688d41eab58a077c85a8b03d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.192444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ed5bb-71aa-4c8e-94cd-0416b90effcf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.193079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4fab6-cf08-40b3-931e-563c3d8c5c28 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0ad7f7688d41eab58a077c85a8b03d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:33.193413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ed5bb-71aa-4c8e-94cd-0416b90effcf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.194142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ed5bb-71aa-4c8e-94cd-0416b90effcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.197254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4fab6-cf08-40b3-931e-563c3d8c5c28 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:33.199837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 190/377] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:43:32 2022] GET /identity/v3/users/ec0ad7f7688d41eab58a077c85a8b03d => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:33.200861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4fab6-cf08-40b3-931e-563c3d8c5c28 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:33.218214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6f3ed5bb-71aa-4c8e-94cd-0416b90effcf None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:33.219881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6f3ed5bb-71aa-4c8e-94cd-0416b90effcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:33.302843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 188/378] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:33.304402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ed5bb-71aa-4c8e-94cd-0416b90effcf None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:33.344096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4fab6-cf08-40b3-931e-563c3d8c5c28 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:33.395086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f98ff-4325-42cf-949e-41ae841aa902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:33.396325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f98ff-4325-42cf-949e-41ae841aa902 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.397441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f98ff-4325-42cf-949e-41ae841aa902 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.397840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f98ff-4325-42cf-949e-41ae841aa902 None admin] PATH_INFO: `/v3/groups/d0edac94d2924dcd98ddf083e3780b72` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.405662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f98ff-4325-42cf-949e-41ae841aa902 None admin] RBAC: Authorizing `identity:get_group(group_id=d0edac94d2924dcd98ddf083e3780b72)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:33.407540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f98ff-4325-42cf-949e-41ae841aa902 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:33.414119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 191/379] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:33 2022] GET /identity/v3/groups/d0edac94d2924dcd98ddf083e3780b72 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:33.414119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f98ff-4325-42cf-949e-41ae841aa902 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:33.455626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ed5bb-71aa-4c8e-94cd-0416b90effcf None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:33.471384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:33.475858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:33.510681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91cc27-1d1c-4b47-93e4-6d243b38b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:33.511572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91cc27-1d1c-4b47-93e4-6d243b38b1ca None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.511862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91cc27-1d1c-4b47-93e4-6d243b38b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.512144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91cc27-1d1c-4b47-93e4-6d243b38b1ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.513908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91cc27-1d1c-4b47-93e4-6d243b38b1ca None admin] RBAC: Adding query filter params (group.id=09c652bb9eb647a893a2f90d23bf1dfe, role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:33.514285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91cc27-1d1c-4b47-93e4-6d243b38b1ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:33.515809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91cc27-1d1c-4b47-93e4-6d243b38b1ca None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:33.523731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 189/380] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:33 2022] GET /identity/v3/role_assignments?group.id=09c652bb9eb647a893a2f90d23bf1dfe&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=1a772cde30724b09b110b5dffecfd462 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:33.524325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91cc27-1d1c-4b47-93e4-6d243b38b1ca None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:33.568521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f98ff-4325-42cf-949e-41ae841aa902 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:33.626649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4f590-3431-46a8-aeeb-03c029f960ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:33.627679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4f590-3431-46a8-aeeb-03c029f960ff None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.628945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4f590-3431-46a8-aeeb-03c029f960ff None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.629408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4f590-3431-46a8-aeeb-03c029f960ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.631451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4f590-3431-46a8-aeeb-03c029f960ff None admin] RBAC: Adding query filter params (role.id=443ff5b7485a44109a9411b445079892, user.id=ec0ad7f7688d41eab58a077c85a8b03d, scope.system=all) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:33.632038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4f590-3431-46a8-aeeb-03c029f960ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:33.634551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4f590-3431-46a8-aeeb-03c029f960ff None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:33.652889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 192/381] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 17 12:43:33 2022] GET /identity/v3/role_assignments?user.id=ec0ad7f7688d41eab58a077c85a8b03d&scope.system=all&role.id=443ff5b7485a44109a9411b445079892 => generated 510 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:33.655566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd03af-73de-4527-9aa6-8cd6529ef6b8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.660262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd03af-73de-4527-9aa6-8cd6529ef6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.660262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd03af-73de-4527-9aa6-8cd6529ef6b8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.660901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 193/382] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:33.663010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd03af-73de-4527-9aa6-8cd6529ef6b8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:33.678302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91cc27-1d1c-4b47-93e4-6d243b38b1ca None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:33.740639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c5bec-40e5-4ca6-85de-9e251af336ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:33.742306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c5bec-40e5-4ca6-85de-9e251af336ae None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.742801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c5bec-40e5-4ca6-85de-9e251af336ae None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.743273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c5bec-40e5-4ca6-85de-9e251af336ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.757087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c5bec-40e5-4ca6-85de-9e251af336ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-183c5bec-40e5-4ca6-85de-9e251af336ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:33.767101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:33.768055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:33.768846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:33.772755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 190/383] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:33.774662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c8fc-066b-4854-8f18-b91b2644b53d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.775252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c8fc-066b-4854-8f18-b91b2644b53d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.775718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c8fc-066b-4854-8f18-b91b2644b53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.795461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b850c8fc-066b-4854-8f18-b91b2644b53d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:33.797266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b850c8fc-066b-4854-8f18-b91b2644b53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:33.832453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:33.845357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd03af-73de-4527-9aa6-8cd6529ef6b8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:33.847203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:33.892105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d3e8a-9ca0-4dbf-bbb5-68f4da3f579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:33.892907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3e8a-9ca0-4dbf-bbb5-68f4da3f579d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:33.893198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3e8a-9ca0-4dbf-bbb5-68f4da3f579d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:33.893482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3e8a-9ca0-4dbf-bbb5-68f4da3f579d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:33.894392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d3e8a-9ca0-4dbf-bbb5-68f4da3f579d None admin] RBAC: Adding query filter params (group.id=d0edac94d2924dcd98ddf083e3780b72, role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=91e888714806438f834a0309a74fcb9e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:33.894709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d3e8a-9ca0-4dbf-bbb5-68f4da3f579d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:33.895475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 191/384] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:33.896395 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d3e8a-9ca0-4dbf-bbb5-68f4da3f579d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:33.896883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c8fc-066b-4854-8f18-b91b2644b53d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:33.904192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 194/385] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:33 2022] GET /identity/v3/role_assignments?group.id=d0edac94d2924dcd98ddf083e3780b72&scope.project.id=91e888714806438f834a0309a74fcb9e&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:33.925877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d3e8a-9ca0-4dbf-bbb5-68f4da3f579d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:34.056240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d3e8a-9ca0-4dbf-bbb5-68f4da3f579d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:34.059688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c8fc-066b-4854-8f18-b91b2644b53d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:34.101864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b64a9f-dd4d-46d0-9bf8-010e074e4a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:34.103099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64a9f-dd4d-46d0-9bf8-010e074e4a92 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:34.103595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64a9f-dd4d-46d0-9bf8-010e074e4a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:34.103947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64a9f-dd4d-46d0-9bf8-010e074e4a92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:34.109838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3685eef-782f-433f-a505-15210ef017bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:34.110588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3685eef-782f-433f-a505-15210ef017bc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:34.110873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3685eef-782f-433f-a505-15210ef017bc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:34.111148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3685eef-782f-433f-a505-15210ef017bc None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:34.112268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3685eef-782f-433f-a505-15210ef017bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:34.112586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3685eef-782f-433f-a505-15210ef017bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:34.114029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3685eef-782f-433f-a505-15210ef017bc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:34.120791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b64a9f-dd4d-46d0-9bf8-010e074e4a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:34.125937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 192/386] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a2b64a9f-dd4d-46d0-9bf8-010e074e4a92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:34.131621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:34.132599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:34.133472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 195/387] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:34.136171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3685eef-782f-433f-a505-15210ef017bc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:34.140670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b64a9f-dd4d-46d0-9bf8-010e074e4a92 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:34.187036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:34.197512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:34.303038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b64a9f-dd4d-46d0-9bf8-010e074e4a92 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:34.345214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3685eef-782f-433f-a505-15210ef017bc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:34.398932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15d312-b9d7-408e-9a01-ec3434f9477b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:34.400452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15d312-b9d7-408e-9a01-ec3434f9477b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:34.400732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316dd90-4d19-466c-92c9-c14e255334f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:34.401156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15d312-b9d7-408e-9a01-ec3434f9477b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:34.401649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316dd90-4d19-466c-92c9-c14e255334f8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:34.401858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15d312-b9d7-408e-9a01-ec3434f9477b None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:34.401952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316dd90-4d19-466c-92c9-c14e255334f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:34.402301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316dd90-4d19-466c-92c9-c14e255334f8 None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:34.403304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15d312-b9d7-408e-9a01-ec3434f9477b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:34.403854 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15d312-b9d7-408e-9a01-ec3434f9477b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:34.405865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15d312-b9d7-408e-9a01-ec3434f9477b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:34.408074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316dd90-4d19-466c-92c9-c14e255334f8 None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:34.410630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316dd90-4d19-466c-92c9-c14e255334f8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:34.416954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 196/389] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:34.417135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 193/389] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:34 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:34.419729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316dd90-4d19-466c-92c9-c14e255334f8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:34.423607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15d312-b9d7-408e-9a01-ec3434f9477b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:34.549575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:34.562297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316dd90-4d19-466c-92c9-c14e255334f8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:34.598027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:34.602403 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25269c-8fb4-4c26-b24e-2e25412c8a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:34.603675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25269c-8fb4-4c26-b24e-2e25412c8a20 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:34.604159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25269c-8fb4-4c26-b24e-2e25412c8a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:34.604628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25269c-8fb4-4c26-b24e-2e25412c8a20 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:34.606150 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25269c-8fb4-4c26-b24e-2e25412c8a20 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:34.607851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25269c-8fb4-4c26-b24e-2e25412c8a20 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:34.610245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 194/390] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:34 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:34.618404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25269c-8fb4-4c26-b24e-2e25412c8a20 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:34.638116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15d312-b9d7-408e-9a01-ec3434f9477b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:34.681152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476f9b7-6f76-498c-93f3-ffd85cf5a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:34.682935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476f9b7-6f76-498c-93f3-ffd85cf5a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:34.683431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476f9b7-6f76-498c-93f3-ffd85cf5a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:34.683845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476f9b7-6f76-498c-93f3-ffd85cf5a9c2 None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:34.686694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476f9b7-6f76-498c-93f3-ffd85cf5a9c2 None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:34.689519 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476f9b7-6f76-498c-93f3-ffd85cf5a9c2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:34.694039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 197/391] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:34 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:34.702585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476f9b7-6f76-498c-93f3-ffd85cf5a9c2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:34.827263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25269c-8fb4-4c26-b24e-2e25412c8a20 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:34.844299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476f9b7-6f76-498c-93f3-ffd85cf5a9c2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:34.903032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b91f0-1adb-47c8-a827-9ae831c13e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:34.903969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b91f0-1adb-47c8-a827-9ae831c13e3c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:34.904256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b91f0-1adb-47c8-a827-9ae831c13e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:34.904541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b91f0-1adb-47c8-a827-9ae831c13e3c None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:34.906826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b91f0-1adb-47c8-a827-9ae831c13e3c None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:34.908366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b91f0-1adb-47c8-a827-9ae831c13e3c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:34.910259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 198/392] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:34 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:34.919258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b91f0-1adb-47c8-a827-9ae831c13e3c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:34.928704 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba03503-aeee-49cd-ac2a-fc96331d0c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:34.929661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba03503-aeee-49cd-ac2a-fc96331d0c1d None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:34.929947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba03503-aeee-49cd-ac2a-fc96331d0c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:34.930269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba03503-aeee-49cd-ac2a-fc96331d0c1d None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae/groups/09c652bb9eb647a893a2f90d23bf1dfe/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:34.932596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba03503-aeee-49cd-ac2a-fc96331d0c1d None admin] RBAC: Authorizing `identity:create_grant(project_id=255f1d6d50524cb9927e19bc3f010eae, group_id=09c652bb9eb647a893a2f90d23bf1dfe, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:34.934159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba03503-aeee-49cd-ac2a-fc96331d0c1d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:34.972898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 195/393] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 12:43:34 2022] PUT /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae/groups/09c652bb9eb647a893a2f90d23bf1dfe/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:34.997217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:35.124009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b91f0-1adb-47c8-a827-9ae831c13e3c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:35.183809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7031e92-4eb8-480e-8c75-6adefaebdcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:35.184802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031e92-4eb8-480e-8c75-6adefaebdcc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:35.185090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031e92-4eb8-480e-8c75-6adefaebdcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:35.185369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031e92-4eb8-480e-8c75-6adefaebdcc7 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae/groups/09c652bb9eb647a893a2f90d23bf1dfe/roles/1a772cde30724b09b110b5dffecfd462` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:35.187989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7031e92-4eb8-480e-8c75-6adefaebdcc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=255f1d6d50524cb9927e19bc3f010eae, group_id=09c652bb9eb647a893a2f90d23bf1dfe, role_id=1a772cde30724b09b110b5dffecfd462)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:35.189603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7031e92-4eb8-480e-8c75-6adefaebdcc7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:35.216212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 199/394] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 12:43:34 2022] PUT /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae/groups/09c652bb9eb647a893a2f90d23bf1dfe/roles/1a772cde30724b09b110b5dffecfd462 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:35.894479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc38be-40a0-420d-9387-eff75c0662e7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:35.895020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc38be-40a0-420d-9387-eff75c0662e7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:35.895020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc38be-40a0-420d-9387-eff75c0662e7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:35.896534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 196/395] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:35.902628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb075b-5c7b-4715-8917-2cc8f853c685 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:35.903107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb075b-5c7b-4715-8917-2cc8f853c685 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:35.903178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb075b-5c7b-4715-8917-2cc8f853c685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:35.927191 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0dcb075b-5c7b-4715-8917-2cc8f853c685 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:35.928786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0dcb075b-5c7b-4715-8917-2cc8f853c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:36.004493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 200/396] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:36.039192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc38be-40a0-420d-9387-eff75c0662e7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:36.083331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:36.247083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc38be-40a0-420d-9387-eff75c0662e7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:36.299945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d9f6c-1cc9-43ec-b86b-e25d5bddeae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:36.300933 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d9f6c-1cc9-43ec-b86b-e25d5bddeae9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:36.301214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d9f6c-1cc9-43ec-b86b-e25d5bddeae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:36.301492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d9f6c-1cc9-43ec-b86b-e25d5bddeae9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:36.325395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d9f6c-1cc9-43ec-b86b-e25d5bddeae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-833d9f6c-1cc9-43ec-b86b-e25d5bddeae9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:36.333954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:36.335190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:36.336421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 197/397] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:36.341786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb075b-5c7b-4715-8917-2cc8f853c685 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:36.387731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:36.535669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb075b-5c7b-4715-8917-2cc8f853c685 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:36.596076 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0df08-9967-4a2a-ab73-a93d5becdad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:36.596799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0df08-9967-4a2a-ab73-a93d5becdad2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:36.597145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0df08-9967-4a2a-ab73-a93d5becdad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:36.597489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0df08-9967-4a2a-ab73-a93d5becdad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:36.598295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0df08-9967-4a2a-ab73-a93d5becdad2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:36.598608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0df08-9967-4a2a-ab73-a93d5becdad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:36.600780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0df08-9967-4a2a-ab73-a93d5becdad2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:36.614883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 201/398] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:36.620794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d9f6c-1cc9-43ec-b86b-e25d5bddeae9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:36.808376 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:36.854950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d9f6c-1cc9-43ec-b86b-e25d5bddeae9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:36.892981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737084-ed17-4151-81ac-146d71b19cba None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:36.893646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737084-ed17-4151-81ac-146d71b19cba None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:36.894184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737084-ed17-4151-81ac-146d71b19cba None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:36.896795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 202/399] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:36.904598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad0905-3462-4fa3-a63b-c73d0a8b9db3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:36.905646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad0905-3462-4fa3-a63b-c73d0a8b9db3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:36.906143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad0905-3462-4fa3-a63b-c73d0a8b9db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:36.922502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252f2d-83f3-47a5-bf33-79de75a4d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:36.923414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252f2d-83f3-47a5-bf33-79de75a4d5ad None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:36.923692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252f2d-83f3-47a5-bf33-79de75a4d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:36.923972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252f2d-83f3-47a5-bf33-79de75a4d5ad None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:36.928114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-baad0905-3462-4fa3-a63b-c73d0a8b9db3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:36.928929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23252f2d-83f3-47a5-bf33-79de75a4d5ad None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:36.929838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-baad0905-3462-4fa3-a63b-c73d0a8b9db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:36.930454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23252f2d-83f3-47a5-bf33-79de75a4d5ad None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:36.932502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 198/400] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:36 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:36.937587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252f2d-83f3-47a5-bf33-79de75a4d5ad None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:37.027317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 203/401] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:37.047496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad0905-3462-4fa3-a63b-c73d0a8b9db3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:37.058665 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:37.182264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252f2d-83f3-47a5-bf33-79de75a4d5ad None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:37.202001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad0905-3462-4fa3-a63b-c73d0a8b9db3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:37.230502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504cc08-98df-43a1-96a9-8776bfc31276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:37.232172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504cc08-98df-43a1-96a9-8776bfc31276 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:37.233141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504cc08-98df-43a1-96a9-8776bfc31276 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:37.234344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504cc08-98df-43a1-96a9-8776bfc31276 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:37.238540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504cc08-98df-43a1-96a9-8776bfc31276 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:37.240644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504cc08-98df-43a1-96a9-8776bfc31276 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:37.243340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77b758-7510-46bd-a161-02682450fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:37.243536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 199/402] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:36 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:37.244508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77b758-7510-46bd-a161-02682450fb91 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:37.244963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77b758-7510-46bd-a161-02682450fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:37.245329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77b758-7510-46bd-a161-02682450fb91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:37.245579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47d700-b4f7-4169-a850-05f5e8e53d5f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:37.245996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47d700-b4f7-4169-a850-05f5e8e53d5f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:37.246589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47d700-b4f7-4169-a850-05f5e8e53d5f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:37.248745 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 200/403] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:37.249730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47d700-b4f7-4169-a850-05f5e8e53d5f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:37.263012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77b758-7510-46bd-a161-02682450fb91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:37.274042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0b77b758-7510-46bd-a161-02682450fb91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:37.275588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:37.276551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:37.277331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:37.280913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 204/404] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:37.282796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12496-b8e9-4698-9350-f2ca71610e62 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:37.283302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12496-b8e9-4698-9350-f2ca71610e62 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:37.283764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12496-b8e9-4698-9350-f2ca71610e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:37.304334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-37a12496-b8e9-4698-9350-f2ca71610e62 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:37.306615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-37a12496-b8e9-4698-9350-f2ca71610e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:37.396844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:37.404021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47d700-b4f7-4169-a850-05f5e8e53d5f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:37.418116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 205/405] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:37.418116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a12496-b8e9-4698-9350-f2ca71610e62 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:37.466909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fae88-a7f3-4cd8-8a4d-e6b01c74caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:37.468229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fae88-a7f3-4cd8-8a4d-e6b01c74caee None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:37.468731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fae88-a7f3-4cd8-8a4d-e6b01c74caee None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:37.469201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fae88-a7f3-4cd8-8a4d-e6b01c74caee None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/groups/09c652bb9eb647a893a2f90d23bf1dfe/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:37.471581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fae88-a7f3-4cd8-8a4d-e6b01c74caee None admin] RBAC: Authorizing `identity:create_grant(project_id=02114f3d5b0740a3bccbe7d0edb81236, group_id=09c652bb9eb647a893a2f90d23bf1dfe, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:37.473354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fae88-a7f3-4cd8-8a4d-e6b01c74caee None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:37.499080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 201/406] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 12:43:37 2022] PUT /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/groups/09c652bb9eb647a893a2f90d23bf1dfe/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:37.501015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fae88-a7f3-4cd8-8a4d-e6b01c74caee None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:37.616435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a12496-b8e9-4698-9350-f2ca71610e62 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:37.693977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810716-49d6-4e09-a049-b182fda72d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:37.695204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810716-49d6-4e09-a049-b182fda72d03 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:37.695728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810716-49d6-4e09-a049-b182fda72d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:37.696334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810716-49d6-4e09-a049-b182fda72d03 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:37.697317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a810716-49d6-4e09-a049-b182fda72d03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:37.697820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a810716-49d6-4e09-a049-b182fda72d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:37.699623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a810716-49d6-4e09-a049-b182fda72d03 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:37.710828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 206/407] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:37.716751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810716-49d6-4e09-a049-b182fda72d03 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:37.728633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:37.787926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fae88-a7f3-4cd8-8a4d-e6b01c74caee None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:37.798198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:37.875950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91823-4aa5-4423-8d16-7ce8231f9a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:37.877172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91823-4aa5-4423-8d16-7ce8231f9a97 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:37.877649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91823-4aa5-4423-8d16-7ce8231f9a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:37.878133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91823-4aa5-4423-8d16-7ce8231f9a97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:37.886006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810716-49d6-4e09-a049-b182fda72d03 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:37.916652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c91823-4aa5-4423-8d16-7ce8231f9a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-27c91823-4aa5-4423-8d16-7ce8231f9a97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:37.925875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:37.927310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:37.928159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:37.945063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 202/408] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:37.962954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91823-4aa5-4423-8d16-7ce8231f9a97 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:37.964795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a4829-612b-4c2e-a583-c002387b52fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:37.966524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a4829-612b-4c2e-a583-c002387b52fa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:37.967013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a4829-612b-4c2e-a583-c002387b52fa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:37.967478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a4829-612b-4c2e-a583-c002387b52fa None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:37.969899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a4829-612b-4c2e-a583-c002387b52fa None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:37.971891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a4829-612b-4c2e-a583-c002387b52fa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:37.974333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 207/409] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:37 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:37.986346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a4829-612b-4c2e-a583-c002387b52fa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:38.117073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91823-4aa5-4423-8d16-7ce8231f9a97 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:38.171530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dd09c-e281-4ff2-90ab-ea4580bcb0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:38.172504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd09c-e281-4ff2-90ab-ea4580bcb0bf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.172968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd09c-e281-4ff2-90ab-ea4580bcb0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.173446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd09c-e281-4ff2-90ab-ea4580bcb0bf None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.175072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dd09c-e281-4ff2-90ab-ea4580bcb0bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:38.175620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dd09c-e281-4ff2-90ab-ea4580bcb0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:38.178177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dd09c-e281-4ff2-90ab-ea4580bcb0bf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:38.192703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 203/410] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:38.193584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:38.203329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dd09c-e281-4ff2-90ab-ea4580bcb0bf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:38.256484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a4829-612b-4c2e-a583-c002387b52fa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:38.298493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:38.309081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1988f4a-48e6-4cbd-b041-48bc9b020460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:38.310145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1988f4a-48e6-4cbd-b041-48bc9b020460 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.310408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1988f4a-48e6-4cbd-b041-48bc9b020460 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.310694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1988f4a-48e6-4cbd-b041-48bc9b020460 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.312608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1988f4a-48e6-4cbd-b041-48bc9b020460 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:38.314771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1988f4a-48e6-4cbd-b041-48bc9b020460 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:38.317838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 208/411] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:37 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:38.319855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cfad5-4320-4309-a135-11cd509fd341 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.320143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cfad5-4320-4309-a135-11cd509fd341 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.320434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cfad5-4320-4309-a135-11cd509fd341 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.322938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 209/412] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:38.325377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cfad5-4320-4309-a135-11cd509fd341 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:38.398178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dd09c-e281-4ff2-90ab-ea4580bcb0bf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:38.448263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3fab6-40f9-43a7-80ff-6f2d7cec2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:38.450178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3fab6-40f9-43a7-80ff-6f2d7cec2f04 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.450893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3fab6-40f9-43a7-80ff-6f2d7cec2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.451375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3fab6-40f9-43a7-80ff-6f2d7cec2f04 None admin] PATH_INFO: `/v3/groups/d0edac94d2924dcd98ddf083e3780b72` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.453201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3fab6-40f9-43a7-80ff-6f2d7cec2f04 None admin] RBAC: Authorizing `identity:get_group(group_id=d0edac94d2924dcd98ddf083e3780b72)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:38.455137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3fab6-40f9-43a7-80ff-6f2d7cec2f04 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:38.457557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 204/413] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:38 2022] GET /identity/v3/groups/d0edac94d2924dcd98ddf083e3780b72 => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:38.459424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0325ee-a4db-4991-969a-6ef7871f0c2f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.459935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0325ee-a4db-4991-969a-6ef7871f0c2f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.460410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0325ee-a4db-4991-969a-6ef7871f0c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.479367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5f0325ee-a4db-4991-969a-6ef7871f0c2f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:38.480968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5f0325ee-a4db-4991-969a-6ef7871f0c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:38.497485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cfad5-4320-4309-a135-11cd509fd341 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:38.537820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e84c3-c48f-45df-bd27-aaef9f18b514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:38.538733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e84c3-c48f-45df-bd27-aaef9f18b514 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.539050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e84c3-c48f-45df-bd27-aaef9f18b514 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.539307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e84c3-c48f-45df-bd27-aaef9f18b514 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/groups/09c652bb9eb647a893a2f90d23bf1dfe/roles/1a772cde30724b09b110b5dffecfd462` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.541638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e84c3-c48f-45df-bd27-aaef9f18b514 None admin] RBAC: Authorizing `identity:create_grant(project_id=02114f3d5b0740a3bccbe7d0edb81236, group_id=09c652bb9eb647a893a2f90d23bf1dfe, role_id=1a772cde30724b09b110b5dffecfd462)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:38.543159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e84c3-c48f-45df-bd27-aaef9f18b514 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:38.578132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 210/414] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 12:43:38 2022] PUT /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236/groups/09c652bb9eb647a893a2f90d23bf1dfe/roles/1a772cde30724b09b110b5dffecfd462 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:38.578132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e84c3-c48f-45df-bd27-aaef9f18b514 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:38.581324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:38.592447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 205/415] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:38.593728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d8415-08f5-4022-a7a1-d9227b4ed889 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.594043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d8415-08f5-4022-a7a1-d9227b4ed889 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.594361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d8415-08f5-4022-a7a1-d9227b4ed889 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.596996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 206/416] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:38.603157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137a7c-6bf8-419a-a142-d0bcb12d641b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.603473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137a7c-6bf8-419a-a142-d0bcb12d641b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.603805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137a7c-6bf8-419a-a142-d0bcb12d641b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.625207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9b137a7c-6bf8-419a-a142-d0bcb12d641b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:38.626532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9b137a7c-6bf8-419a-a142-d0bcb12d641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:38.660254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:38.720537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e84c3-c48f-45df-bd27-aaef9f18b514 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:38.732782 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 207/417] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:38.733702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137a7c-6bf8-419a-a142-d0bcb12d641b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:38.776537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b000d35-20d9-4c99-a06d-a82f1cb22c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:38.778121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000d35-20d9-4c99-a06d-a82f1cb22c0e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.778598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000d35-20d9-4c99-a06d-a82f1cb22c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.779072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000d35-20d9-4c99-a06d-a82f1cb22c0e None admin] PATH_INFO: `/v3/projects/91e888714806438f834a0309a74fcb9e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.781411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b000d35-20d9-4c99-a06d-a82f1cb22c0e None admin] RBAC: Authorizing `identity:get_project(project_id=91e888714806438f834a0309a74fcb9e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:38.784255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b000d35-20d9-4c99-a06d-a82f1cb22c0e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:38.788500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 211/418] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:38 2022] GET /identity/v3/projects/91e888714806438f834a0309a74fcb9e => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:38.790177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b000d35-20d9-4c99-a06d-a82f1cb22c0e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:38.863928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137a7c-6bf8-419a-a142-d0bcb12d641b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:38.906539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:38.915347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c328-2b96-4763-a64e-69a3954c8fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:38.917113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c328-2b96-4763-a64e-69a3954c8fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.917590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c328-2b96-4763-a64e-69a3954c8fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.918079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427c328-2b96-4763-a64e-69a3954c8fb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:38.939716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427c328-2b96-4763-a64e-69a3954c8fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:38.948057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b000d35-20d9-4c99-a06d-a82f1cb22c0e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a427c328-2b96-4763-a64e-69a3954c8fb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:38.949258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:38.950327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:38.951106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:38.951715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 208/419] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:38.953201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c328-2b96-4763-a64e-69a3954c8fb6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:38.977872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:38.991674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e71d-aa9d-47e1-9fcc-61120acd90b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:38.992631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e71d-aa9d-47e1-9fcc-61120acd90b2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:38.992914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e71d-aa9d-47e1-9fcc-61120acd90b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:38.993185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e71d-aa9d-47e1-9fcc-61120acd90b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:39.005339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e71d-aa9d-47e1-9fcc-61120acd90b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8db3e71d-aa9d-47e1-9fcc-61120acd90b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:39.015150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:39.016886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:39.017841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:39.022343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 212/420] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:39.023440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e71d-aa9d-47e1-9fcc-61120acd90b2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:39.081464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427c328-2b96-4763-a64e-69a3954c8fb6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:39.121859 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ad8be-7756-412f-bb8c-7d94510087c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:39.123069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ad8be-7756-412f-bb8c-7d94510087c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:39.123520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ad8be-7756-412f-bb8c-7d94510087c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:39.124018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ad8be-7756-412f-bb8c-7d94510087c5 None admin] PATH_INFO: `/v3/projects/91e888714806438f834a0309a74fcb9e/groups/d0edac94d2924dcd98ddf083e3780b72/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:39.127184 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ad8be-7756-412f-bb8c-7d94510087c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=91e888714806438f834a0309a74fcb9e, group_id=d0edac94d2924dcd98ddf083e3780b72, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:39.129094 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ad8be-7756-412f-bb8c-7d94510087c5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:39.134325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e71d-aa9d-47e1-9fcc-61120acd90b2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:39.147799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 209/421] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 17 12:43:38 2022] PUT /identity/v3/projects/91e888714806438f834a0309a74fcb9e/groups/d0edac94d2924dcd98ddf083e3780b72/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:43:39.149294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ad8be-7756-412f-bb8c-7d94510087c5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:39.214941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54709291-b7b2-4c3e-bc56-e015ae6123e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:39.215800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709291-b7b2-4c3e-bc56-e015ae6123e0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:39.216211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709291-b7b2-4c3e-bc56-e015ae6123e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:39.216493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709291-b7b2-4c3e-bc56-e015ae6123e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:39.217291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54709291-b7b2-4c3e-bc56-e015ae6123e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:39.217785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54709291-b7b2-4c3e-bc56-e015ae6123e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:39.219341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:39.220564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54709291-b7b2-4c3e-bc56-e015ae6123e0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:39.269912 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 213/422] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:39.275243 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54709291-b7b2-4c3e-bc56-e015ae6123e0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:39.289853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ad8be-7756-412f-bb8c-7d94510087c5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:39.339017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2023d40-d5c4-4f00-a466-02c3ac21cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:39.340188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2023d40-d5c4-4f00-a466-02c3ac21cb12 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:39.340727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2023d40-d5c4-4f00-a466-02c3ac21cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:39.341214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2023d40-d5c4-4f00-a466-02c3ac21cb12 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:39.342272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2023d40-d5c4-4f00-a466-02c3ac21cb12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:39.342865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2023d40-d5c4-4f00-a466-02c3ac21cb12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:39.345067 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2023d40-d5c4-4f00-a466-02c3ac21cb12 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:39.357354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 210/423] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:39.363333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2023d40-d5c4-4f00-a466-02c3ac21cb12 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:39.395783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:39.460666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54709291-b7b2-4c3e-bc56-e015ae6123e0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:39.499134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57fd67-b639-4fbe-9795-bb3560d69cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:39.499830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57fd67-b639-4fbe-9795-bb3560d69cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:39.500120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57fd67-b639-4fbe-9795-bb3560d69cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:39.500604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57fd67-b639-4fbe-9795-bb3560d69cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:39.507797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2023d40-d5c4-4f00-a466-02c3ac21cb12 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:39.522782 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:39.562794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeaca8-9f28-473f-835e-7cbe653994e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:39.564139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeaca8-9f28-473f-835e-7cbe653994e5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:39.564619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeaca8-9f28-473f-835e-7cbe653994e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:39.565122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeaca8-9f28-473f-835e-7cbe653994e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:39.598412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57fd67-b639-4fbe-9795-bb3560d69cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:39.601006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57fd67-b639-4fbe-9795-bb3560d69cf5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:39.644345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeaca8-9f28-473f-835e-7cbe653994e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:39.646053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeaca8-9f28-473f-835e-7cbe653994e5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:39.661759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:39.728859 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 214/424] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:39.730649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57fd67-b639-4fbe-9795-bb3560d69cf5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:39.835611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57fd67-b639-4fbe-9795-bb3560d69cf5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:39.886962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f166bd1-a168-4587-b78f-d6f9e26dbb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:39.888277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f166bd1-a168-4587-b78f-d6f9e26dbb11 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:39.888761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f166bd1-a168-4587-b78f-d6f9e26dbb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:39.889274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f166bd1-a168-4587-b78f-d6f9e26dbb11 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:39.890893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f166bd1-a168-4587-b78f-d6f9e26dbb11 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:39.891595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 211/425] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 12:43:39.892962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f166bd1-a168-4587-b78f-d6f9e26dbb11 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:39.894955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 215/426] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:39 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:39.899266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeaca8-9f28-473f-835e-7cbe653994e5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:39.909213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f166bd1-a168-4587-b78f-d6f9e26dbb11 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:39.913540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:39.938124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:40.014483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeaca8-9f28-473f-835e-7cbe653994e5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:40.060477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a678a1-e0ab-4382-a8ec-fe9b30bee125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:40.061856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a678a1-e0ab-4382-a8ec-fe9b30bee125 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:40.062467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a678a1-e0ab-4382-a8ec-fe9b30bee125 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:40.063015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a678a1-e0ab-4382-a8ec-fe9b30bee125 None admin] PATH_INFO: `/v3/projects/255f1d6d50524cb9927e19bc3f010eae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:40.066867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a678a1-e0ab-4382-a8ec-fe9b30bee125 None admin] RBAC: Authorizing `identity:get_project(project_id=255f1d6d50524cb9927e19bc3f010eae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:40.069208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a678a1-e0ab-4382-a8ec-fe9b30bee125 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:40.071757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 212/427] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:39 2022] GET /identity/v3/projects/255f1d6d50524cb9927e19bc3f010eae => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:40.082519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a678a1-e0ab-4382-a8ec-fe9b30bee125 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:40.103363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f166bd1-a168-4587-b78f-d6f9e26dbb11 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:40.145144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014325f3-b1a0-4674-97c3-3f65bd458924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:40.147029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014325f3-b1a0-4674-97c3-3f65bd458924 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:40.147606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014325f3-b1a0-4674-97c3-3f65bd458924 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:40.148125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014325f3-b1a0-4674-97c3-3f65bd458924 None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:40.149778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014325f3-b1a0-4674-97c3-3f65bd458924 None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:40.152353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014325f3-b1a0-4674-97c3-3f65bd458924 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:40.154328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 216/428] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:39 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:40.155458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738f4ba-25d3-4153-8b3f-bb29e1c3b42f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:40.155749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738f4ba-25d3-4153-8b3f-bb29e1c3b42f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:40.156725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738f4ba-25d3-4153-8b3f-bb29e1c3b42f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:40.159181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 217/429] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:40.163480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738f4ba-25d3-4153-8b3f-bb29e1c3b42f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:40.213627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:40.246943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a678a1-e0ab-4382-a8ec-fe9b30bee125 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:40.292168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37108-6e62-47b2-9972-315b97ef8883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:40.293155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37108-6e62-47b2-9972-315b97ef8883 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:40.293453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37108-6e62-47b2-9972-315b97ef8883 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:40.293732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37108-6e62-47b2-9972-315b97ef8883 None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:40.295186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb37108-6e62-47b2-9972-315b97ef8883 None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:40.296761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb37108-6e62-47b2-9972-315b97ef8883 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:40.302515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 213/430] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:40 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:40.304448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48eab-5a7e-465b-b1f5-4ccec921722f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:40.304740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48eab-5a7e-465b-b1f5-4ccec921722f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:40.305024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a48eab-5a7e-465b-b1f5-4ccec921722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:40.320752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:40.342081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a4a48eab-5a7e-465b-b1f5-4ccec921722f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:40.343418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a4a48eab-5a7e-465b-b1f5-4ccec921722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:40.351127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738f4ba-25d3-4153-8b3f-bb29e1c3b42f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:40.418557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e359a6-aa51-408e-8af3-750c158864b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:40.420136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e359a6-aa51-408e-8af3-750c158864b4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:40.420672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e359a6-aa51-408e-8af3-750c158864b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:40.421380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e359a6-aa51-408e-8af3-750c158864b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:40.422448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e359a6-aa51-408e-8af3-750c158864b4 None admin] RBAC: Adding query filter params (group.id=09c652bb9eb647a893a2f90d23bf1dfe, role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=255f1d6d50524cb9927e19bc3f010eae) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:40.422908 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e359a6-aa51-408e-8af3-750c158864b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:40.425415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e359a6-aa51-408e-8af3-750c158864b4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:40.441043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 218/431] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:40 2022] GET /identity/v3/role_assignments?group.id=09c652bb9eb647a893a2f90d23bf1dfe&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=3d852826ac0a4f09b618a220333f2897 => generated 611 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:40.442385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e359a6-aa51-408e-8af3-750c158864b4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:40.472205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 214/432] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:40.548777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48eab-5a7e-465b-b1f5-4ccec921722f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:40.628120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e359a6-aa51-408e-8af3-750c158864b4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:40.694694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7e612-9a4b-49ce-9382-7521f565d945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:40.695759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7e612-9a4b-49ce-9382-7521f565d945 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:40.696262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7e612-9a4b-49ce-9382-7521f565d945 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:40.696774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7e612-9a4b-49ce-9382-7521f565d945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:40.697821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7e612-9a4b-49ce-9382-7521f565d945 None admin] RBAC: Adding query filter params (group.id=09c652bb9eb647a893a2f90d23bf1dfe, role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=255f1d6d50524cb9927e19bc3f010eae) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:40.698365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7e612-9a4b-49ce-9382-7521f565d945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:40.700076 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7e612-9a4b-49ce-9382-7521f565d945 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:40.708128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 219/433] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:40 2022] GET /identity/v3/role_assignments?group.id=09c652bb9eb647a893a2f90d23bf1dfe&scope.project.id=255f1d6d50524cb9927e19bc3f010eae&role.id=1a772cde30724b09b110b5dffecfd462 => generated 611 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:40.778874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:40.825078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a48eab-5a7e-465b-b1f5-4ccec921722f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:40.888248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b3bf3-5d72-4466-bbf8-b9dd1e97d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:40.889583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b3bf3-5d72-4466-bbf8-b9dd1e97d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:40.890170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b3bf3-5d72-4466-bbf8-b9dd1e97d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:40.890710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b3bf3-5d72-4466-bbf8-b9dd1e97d7f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:40.905286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b3bf3-5d72-4466-bbf8-b9dd1e97d7f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f33b3bf3-5d72-4466-bbf8-b9dd1e97d7f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:40.916931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:40.917907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 12:43:40.918741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:40.921328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 215/434] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:40.928389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7e612-9a4b-49ce-9382-7521f565d945 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:40.943606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:41.056778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7e612-9a4b-49ce-9382-7521f565d945 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:41.097653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1b0d6-0a14-419f-8e53-3cf1db99c747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:41.098387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1b0d6-0a14-419f-8e53-3cf1db99c747 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:41.098678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1b0d6-0a14-419f-8e53-3cf1db99c747 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:41.099031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1b0d6-0a14-419f-8e53-3cf1db99c747 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:41.100878 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1b0d6-0a14-419f-8e53-3cf1db99c747 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:41.101269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1b0d6-0a14-419f-8e53-3cf1db99c747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:41.102798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1b0d6-0a14-419f-8e53-3cf1db99c747 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:41.113593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 220/435] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:43:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:41.120426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b3bf3-5d72-4466-bbf8-b9dd1e97d7f9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:41.252889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b3bf3-5d72-4466-bbf8-b9dd1e97d7f9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:41.300568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d213566-8619-42ab-9260-1e366f3ff382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:41.301268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d213566-8619-42ab-9260-1e366f3ff382 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:41.301558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d213566-8619-42ab-9260-1e366f3ff382 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:41.301841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d213566-8619-42ab-9260-1e366f3ff382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:41.313082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:41.401666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d213566-8619-42ab-9260-1e366f3ff382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:41.403642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d213566-8619-42ab-9260-1e366f3ff382 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:41.473105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbaf26-5b48-4fa4-b957-2864ffa6697b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:41.473432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbaf26-5b48-4fa4-b957-2864ffa6697b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:41.473678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbaf26-5b48-4fa4-b957-2864ffa6697b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:41.476217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 221/436] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:41.483606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108643f-24c1-4681-956e-3dc58262c44c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:41.484168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108643f-24c1-4681-956e-3dc58262c44c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:41.484450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108643f-24c1-4681-956e-3dc58262c44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:41.506397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6108643f-24c1-4681-956e-3dc58262c44c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:41.507614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6108643f-24c1-4681-956e-3dc58262c44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:41.537912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 216/437] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:41.544030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d213566-8619-42ab-9260-1e366f3ff382 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:41.584146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:41.589709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:41.602156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 222/438] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:41.624444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108643f-24c1-4681-956e-3dc58262c44c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:41.678564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d213566-8619-42ab-9260-1e366f3ff382 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:41.730398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34ffbf-e1f3-43e2-866e-1f248b529972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:41.731418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34ffbf-e1f3-43e2-866e-1f248b529972 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:41.731701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34ffbf-e1f3-43e2-866e-1f248b529972 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:41.731992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34ffbf-e1f3-43e2-866e-1f248b529972 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:41.733479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34ffbf-e1f3-43e2-866e-1f248b529972 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:41.734980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34ffbf-e1f3-43e2-866e-1f248b529972 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:41.742137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 217/439] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:41 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:41.749101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34ffbf-e1f3-43e2-866e-1f248b529972 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:41.757146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108643f-24c1-4681-956e-3dc58262c44c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:41.799691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248e74e-c089-4084-ade9-b3bc8a57edda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:41.800532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e74e-c089-4084-ade9-b3bc8a57edda None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:41.800816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e74e-c089-4084-ade9-b3bc8a57edda None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:41.801092 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e74e-c089-4084-ade9-b3bc8a57edda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:41.812908 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248e74e-c089-4084-ade9-b3bc8a57edda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1248e74e-c089-4084-ade9-b3bc8a57edda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:41.822411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:41.824203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 223/440] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9443-7b71-4298-9a63-da016a4b3ad6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:41.826794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9443-7b71-4298-9a63-da016a4b3ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:41.826794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9443-7b71-4298-9a63-da016a4b3ad6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:41.827734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 224/441] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:41.834816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eef48-74e4-4832-94ef-f63c4fad8a5e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:41.835060 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eef48-74e4-4832-94ef-f63c4fad8a5e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:41.835299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eef48-74e4-4832-94ef-f63c4fad8a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:41.857480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6a2eef48-74e4-4832-94ef-f63c4fad8a5e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:41.858798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6a2eef48-74e4-4832-94ef-f63c4fad8a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:41.890905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34ffbf-e1f3-43e2-866e-1f248b529972 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:41.893333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:41.935916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f7a5c-286c-4795-9b47-2dbd628d1428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:41.936846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f7a5c-286c-4795-9b47-2dbd628d1428 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:41.937127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f7a5c-286c-4795-9b47-2dbd628d1428 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:41.937381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f7a5c-286c-4795-9b47-2dbd628d1428 None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:41.938533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:41.938651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f7a5c-286c-4795-9b47-2dbd628d1428 None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:41.940111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f7a5c-286c-4795-9b47-2dbd628d1428 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:41.941856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 218/442] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:41 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:41.943301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f7a5c-286c-4795-9b47-2dbd628d1428 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:41.957311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 225/443] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:41.958503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eef48-74e4-4832-94ef-f63c4fad8a5e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:42.070953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f7a5c-286c-4795-9b47-2dbd628d1428 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:42.108540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eef48-74e4-4832-94ef-f63c4fad8a5e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:42.124262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed57145-53c2-4f64-a529-c9d9eb8c62b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:42.125051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57145-53c2-4f64-a529-c9d9eb8c62b8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:42.125234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57145-53c2-4f64-a529-c9d9eb8c62b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:42.125504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57145-53c2-4f64-a529-c9d9eb8c62b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:42.126313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed57145-53c2-4f64-a529-c9d9eb8c62b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:42.126619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed57145-53c2-4f64-a529-c9d9eb8c62b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:42.128044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed57145-53c2-4f64-a529-c9d9eb8c62b8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:42.138297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 219/444] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:42.139272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed57145-53c2-4f64-a529-c9d9eb8c62b8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:42.159193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e98b9-dc8d-4f85-979c-346976e46a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:42.159882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e98b9-dc8d-4f85-979c-346976e46a57 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:42.160157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e98b9-dc8d-4f85-979c-346976e46a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:42.160427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e98b9-dc8d-4f85-979c-346976e46a57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:42.161266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e98b9-dc8d-4f85-979c-346976e46a57 None admin] RBAC: Adding query filter params (group.id=09c652bb9eb647a893a2f90d23bf1dfe, role.id=3d852826ac0a4f09b618a220333f2897, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:42.161641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e98b9-dc8d-4f85-979c-346976e46a57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:42.163219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e98b9-dc8d-4f85-979c-346976e46a57 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:42.169798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 226/445] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:41 2022] GET /identity/v3/role_assignments?group.id=09c652bb9eb647a893a2f90d23bf1dfe&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=3d852826ac0a4f09b618a220333f2897 => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:42.170651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e98b9-dc8d-4f85-979c-346976e46a57 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:42.186545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:42.245948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:42.284531 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed57145-53c2-4f64-a529-c9d9eb8c62b8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:42.317516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e98b9-dc8d-4f85-979c-346976e46a57 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:42.336482 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899d8c7-665f-4457-a5df-34013b9d5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:42.337333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899d8c7-665f-4457-a5df-34013b9d5225 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:42.337617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899d8c7-665f-4457-a5df-34013b9d5225 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:42.337901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899d8c7-665f-4457-a5df-34013b9d5225 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:42.352083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899d8c7-665f-4457-a5df-34013b9d5225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5899d8c7-665f-4457-a5df-34013b9d5225 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:42.360509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:42.361603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:42.362811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 220/446] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:42.370679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899d8c7-665f-4457-a5df-34013b9d5225 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:42.377240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b0adc-5f91-447c-9cc9-084a3d2ea8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:42.378323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b0adc-5f91-447c-9cc9-084a3d2ea8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:42.378741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b0adc-5f91-447c-9cc9-084a3d2ea8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:42.379136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b0adc-5f91-447c-9cc9-084a3d2ea8f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:42.511327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b0adc-5f91-447c-9cc9-084a3d2ea8f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:42.514404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:42.514721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b0adc-5f91-447c-9cc9-084a3d2ea8f9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:42.528484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899d8c7-665f-4457-a5df-34013b9d5225 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:42.578127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9972a2-0a78-4c62-8d54-71e603a09098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:42.578862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9972a2-0a78-4c62-8d54-71e603a09098 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:42.579149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9972a2-0a78-4c62-8d54-71e603a09098 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:42.579427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9972a2-0a78-4c62-8d54-71e603a09098 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:42.580264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9972a2-0a78-4c62-8d54-71e603a09098 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:42.580524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9972a2-0a78-4c62-8d54-71e603a09098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:42.581949 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9972a2-0a78-4c62-8d54-71e603a09098 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:42.588132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:42.596252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 221/447] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:42.602231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9972a2-0a78-4c62-8d54-71e603a09098 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:42.644596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 227/448] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:42.651157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b0adc-5f91-447c-9cc9-084a3d2ea8f9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:42.718387 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9972a2-0a78-4c62-8d54-71e603a09098 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:42.754498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923e452-1c1e-41d8-95f9-5130bcbd6d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:42.755174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923e452-1c1e-41d8-95f9-5130bcbd6d12 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:42.755487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923e452-1c1e-41d8-95f9-5130bcbd6d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:42.755781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923e452-1c1e-41d8-95f9-5130bcbd6d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:42.771029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b0adc-5f91-447c-9cc9-084a3d2ea8f9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:42.795442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:42.814134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de36776-9bb2-4e55-9f87-e0144177e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:42.815656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de36776-9bb2-4e55-9f87-e0144177e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:42.816178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de36776-9bb2-4e55-9f87-e0144177e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:42.816572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de36776-9bb2-4e55-9f87-e0144177e2b9 None admin] PATH_INFO: `/v3/projects/02114f3d5b0740a3bccbe7d0edb81236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:42.818810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de36776-9bb2-4e55-9f87-e0144177e2b9 None admin] RBAC: Authorizing `identity:get_project(project_id=02114f3d5b0740a3bccbe7d0edb81236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:42.821396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de36776-9bb2-4e55-9f87-e0144177e2b9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:42.824649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 228/449] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:42 2022] GET /identity/v3/projects/02114f3d5b0740a3bccbe7d0edb81236 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:42.830074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de36776-9bb2-4e55-9f87-e0144177e2b9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:42.844263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923e452-1c1e-41d8-95f9-5130bcbd6d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:42.845767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923e452-1c1e-41d8-95f9-5130bcbd6d12 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:42.859999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:42.951312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de36776-9bb2-4e55-9f87-e0144177e2b9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:42.972834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 222/450] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 12:43:42.974283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923e452-1c1e-41d8-95f9-5130bcbd6d12 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:42.987027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ce80e-1f7a-454d-a2b6-450ee9c3ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:42.988257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ce80e-1f7a-454d-a2b6-450ee9c3ee56 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:42.988531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ce80e-1f7a-454d-a2b6-450ee9c3ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:42.988816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ce80e-1f7a-454d-a2b6-450ee9c3ee56 None admin] PATH_INFO: `/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:42.990277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ce80e-1f7a-454d-a2b6-450ee9c3ee56 None admin] RBAC: Authorizing `identity:get_group(group_id=09c652bb9eb647a893a2f90d23bf1dfe)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:42.991902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ce80e-1f7a-454d-a2b6-450ee9c3ee56 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:42.993545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 229/451] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:42 2022] GET /identity/v3/groups/09c652bb9eb647a893a2f90d23bf1dfe => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:42.999573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ce80e-1f7a-454d-a2b6-450ee9c3ee56 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:43.034109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:43.079386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923e452-1c1e-41d8-95f9-5130bcbd6d12 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:43.089986 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:43.100532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ce80e-1f7a-454d-a2b6-450ee9c3ee56 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:43.118422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8f086-c523-426f-b2c6-efe217f1990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:43.120399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f086-c523-426f-b2c6-efe217f1990d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:43.120895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f086-c523-426f-b2c6-efe217f1990d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:43.121639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f086-c523-426f-b2c6-efe217f1990d None admin] PATH_INFO: `/v3/projects/91e888714806438f834a0309a74fcb9e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:43.123538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8f086-c523-426f-b2c6-efe217f1990d None admin] RBAC: Authorizing `identity:get_project(project_id=91e888714806438f834a0309a74fcb9e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:43.125007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8f086-c523-426f-b2c6-efe217f1990d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:43.126763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 223/452] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:43:42 2022] GET /identity/v3/projects/91e888714806438f834a0309a74fcb9e => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:43.132580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8f086-c523-426f-b2c6-efe217f1990d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:43.141040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ab96-1ad4-4510-85e4-adb3c3e7fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:43.141769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ab96-1ad4-4510-85e4-adb3c3e7fe6c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:43.142003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ab96-1ad4-4510-85e4-adb3c3e7fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:43.142316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ab96-1ad4-4510-85e4-adb3c3e7fe6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:43.143154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2ab96-1ad4-4510-85e4-adb3c3e7fe6c None admin] RBAC: Adding query filter params (group.id=09c652bb9eb647a893a2f90d23bf1dfe, role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=02114f3d5b0740a3bccbe7d0edb81236) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:43.143479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2ab96-1ad4-4510-85e4-adb3c3e7fe6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:43.144966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2ab96-1ad4-4510-85e4-adb3c3e7fe6c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:43.152319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 230/453] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:42 2022] GET /identity/v3/role_assignments?group.id=09c652bb9eb647a893a2f90d23bf1dfe&scope.project.id=02114f3d5b0740a3bccbe7d0edb81236&role.id=1a772cde30724b09b110b5dffecfd462 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:43.260689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8f086-c523-426f-b2c6-efe217f1990d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:43.291802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:43.304786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ef11d-4718-4ae3-bd4b-e08cdcafc424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:43.308333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ef11d-4718-4ae3-bd4b-e08cdcafc424 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:43.308333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ef11d-4718-4ae3-bd4b-e08cdcafc424 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:43.308333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ef11d-4718-4ae3-bd4b-e08cdcafc424 None admin] PATH_INFO: `/v3/groups/d0edac94d2924dcd98ddf083e3780b72` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:43.309640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ef11d-4718-4ae3-bd4b-e08cdcafc424 None admin] RBAC: Authorizing `identity:get_group(group_id=d0edac94d2924dcd98ddf083e3780b72)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:43.311364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ef11d-4718-4ae3-bd4b-e08cdcafc424 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:43.313215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 224/454] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 17 12:43:43 2022] GET /identity/v3/groups/d0edac94d2924dcd98ddf083e3780b72 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:43.320391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ab96-1ad4-4510-85e4-adb3c3e7fe6c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:43.435985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ab96-1ad4-4510-85e4-adb3c3e7fe6c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:43.471776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bb558-65ab-4848-a888-ad762bc147fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:43.472458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bb558-65ab-4848-a888-ad762bc147fd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:43.472745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bb558-65ab-4848-a888-ad762bc147fd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:43.473026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bb558-65ab-4848-a888-ad762bc147fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:43.473874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bb558-65ab-4848-a888-ad762bc147fd None admin] RBAC: Adding query filter params (group.id=d0edac94d2924dcd98ddf083e3780b72, role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=91e888714806438f834a0309a74fcb9e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:43.474864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bb558-65ab-4848-a888-ad762bc147fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:43.476564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bb558-65ab-4848-a888-ad762bc147fd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:43.482985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 231/455] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 17 12:43:43 2022] GET /identity/v3/role_assignments?group.id=d0edac94d2924dcd98ddf083e3780b72&scope.project.id=91e888714806438f834a0309a74fcb9e&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:46.316625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8678a9-7e61-48a0-94fc-d4923ee2fe0a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.317434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8678a9-7e61-48a0-94fc-d4923ee2fe0a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.317904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8678a9-7e61-48a0-94fc-d4923ee2fe0a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.320422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 225/456] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:46.326138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faffaa-424e-42bd-a181-92325ddf55d7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.326590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faffaa-424e-42bd-a181-92325ddf55d7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.326882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faffaa-424e-42bd-a181-92325ddf55d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.350283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-81faffaa-424e-42bd-a181-92325ddf55d7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:46.351500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-81faffaa-424e-42bd-a181-92325ddf55d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:46.367985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:46.457026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 232/457] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:46.511940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8678a9-7e61-48a0-94fc-d4923ee2fe0a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:46.621364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19908f19-c356-4248-8b06-80b6a18f70e5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.621657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19908f19-c356-4248-8b06-80b6a18f70e5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.622170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19908f19-c356-4248-8b06-80b6a18f70e5 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.624219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 233/458] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:46.637362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba205e67-4952-4fbc-9182-31816e1212bb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.637890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba205e67-4952-4fbc-9182-31816e1212bb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.638380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba205e67-4952-4fbc-9182-31816e1212bb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.640533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 234/459] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:46.647877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42758fed-4df9-4df1-aeb7-7c7fdbfa8720 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.648524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42758fed-4df9-4df1-aeb7-7c7fdbfa8720 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.648802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42758fed-4df9-4df1-aeb7-7c7fdbfa8720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.670651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8678a9-7e61-48a0-94fc-d4923ee2fe0a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:46.672868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-42758fed-4df9-4df1-aeb7-7c7fdbfa8720 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:46.674374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-42758fed-4df9-4df1-aeb7-7c7fdbfa8720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:46.713400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d8646-867a-423d-a5e4-c9884170798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:46.714267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8646-867a-423d-a5e4-c9884170798c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.714632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8646-867a-423d-a5e4-c9884170798c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.714838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8646-867a-423d-a5e4-c9884170798c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.726039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d8646-867a-423d-a5e4-c9884170798c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:46.728100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d8646-867a-423d-a5e4-c9884170798c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-aa2d8646-867a-423d-a5e4-c9884170798c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:46.748089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:46.749013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:46.756389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:46.756389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:46.756389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:46.756389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:46.756389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 226/460] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:46.756389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354c4b-0d14-4ab7-8412-40d8e531c631 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.756389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354c4b-0d14-4ab7-8412-40d8e531c631 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.756389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354c4b-0d14-4ab7-8412-40d8e531c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.771453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 235/461] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:46.773171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692955-7c92-4ee7-9a8e-cc147121c225 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.773600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692955-7c92-4ee7-9a8e-cc147121c225 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.773760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3b354c4b-0d14-4ab7-8412-40d8e531c631 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:46.774221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692955-7c92-4ee7-9a8e-cc147121c225 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.775222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3b354c4b-0d14-4ab7-8412-40d8e531c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:46.776156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 236/462] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:46.777021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45692955-7c92-4ee7-9a8e-cc147121c225 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:46.830078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:46.864382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 227/463] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:46.866047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb04ce-053c-4625-9e77-ba2ad6060050 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.866701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb04ce-053c-4625-9e77-ba2ad6060050 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.867118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb04ce-053c-4625-9e77-ba2ad6060050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.888748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-79fb04ce-053c-4625-9e77-ba2ad6060050 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:46.890451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-79fb04ce-053c-4625-9e77-ba2ad6060050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:46.899161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:46.929635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45692955-7c92-4ee7-9a8e-cc147121c225 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:46.976456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 228/464] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:46.978266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb04ce-053c-4625-9e77-ba2ad6060050 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:46.993843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5a727-b0aa-4529-811f-b4c6f72acc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:46.995112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5a727-b0aa-4529-811f-b4c6f72acc91 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:46.995687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5a727-b0aa-4529-811f-b4c6f72acc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:46.996102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5a727-b0aa-4529-811f-b4c6f72acc91 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:46.997166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5a727-b0aa-4529-811f-b4c6f72acc91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:46.998079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5a727-b0aa-4529-811f-b4c6f72acc91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:46.999996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5a727-b0aa-4529-811f-b4c6f72acc91 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:47.019466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 237/465] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:47.019466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5a727-b0aa-4529-811f-b4c6f72acc91 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:47.104321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb04ce-053c-4625-9e77-ba2ad6060050 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:47.106758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:47.148376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5a727-b0aa-4529-811f-b4c6f72acc91 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:47.150848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c9da3-15ce-4ecf-be9a-b2e5b94506d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:47.152211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c9da3-15ce-4ecf-be9a-b2e5b94506d8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.152596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c9da3-15ce-4ecf-be9a-b2e5b94506d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.152978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c9da3-15ce-4ecf-be9a-b2e5b94506d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.169687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c9da3-15ce-4ecf-be9a-b2e5b94506d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:47.172224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c9da3-15ce-4ecf-be9a-b2e5b94506d8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8e9c9da3-15ce-4ecf-be9a-b2e5b94506d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:47.196068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:47.197307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:47.199466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:47.199466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:47.199466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:47.199466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:47.199466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 229/466] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:47.199466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c9da3-15ce-4ecf-be9a-b2e5b94506d8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:47.208478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a19f50-de34-44a9-995c-9734cfde871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:47.209770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a19f50-de34-44a9-995c-9734cfde871a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.210216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a19f50-de34-44a9-995c-9734cfde871a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.210612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a19f50-de34-44a9-995c-9734cfde871a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.219282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:47.227065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a19f50-de34-44a9-995c-9734cfde871a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:47.228581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a19f50-de34-44a9-995c-9734cfde871a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-63a19f50-de34-44a9-995c-9734cfde871a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:47.252484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:47.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:47.254543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:47.254543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:47.254543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:47.254543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:47.254543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 238/467] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:47.255198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a19f50-de34-44a9-995c-9734cfde871a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:47.343201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c9da3-15ce-4ecf-be9a-b2e5b94506d8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:47.387034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a19f50-de34-44a9-995c-9734cfde871a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:47.398295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325440f-b45b-4eed-a7ed-bdccd5187fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:47.399432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325440f-b45b-4eed-a7ed-bdccd5187fdf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.399547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325440f-b45b-4eed-a7ed-bdccd5187fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.399783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325440f-b45b-4eed-a7ed-bdccd5187fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.413716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325440f-b45b-4eed-a7ed-bdccd5187fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:47.415250 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325440f-b45b-4eed-a7ed-bdccd5187fdf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:47.425887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63626-8283-4b1e-bc1d-b6915867f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:47.426768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63626-8283-4b1e-bc1d-b6915867f7f5 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.427120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63626-8283-4b1e-bc1d-b6915867f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.427574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63626-8283-4b1e-bc1d-b6915867f7f5 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.428513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63626-8283-4b1e-bc1d-b6915867f7f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:47.430054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63626-8283-4b1e-bc1d-b6915867f7f5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9325440f-b45b-4eed-a7ed-bdccd5187fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:47.435904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:47.436830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:47.443496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:47.443496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:47.443496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:47.443496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:47.443496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 230/468] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:47.443496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325440f-b45b-4eed-a7ed-bdccd5187fdf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:47.455941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:47.474136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 239/469] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:43:47 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:43:47.474136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63626-8283-4b1e-bc1d-b6915867f7f5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:47.546165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:47.597731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325440f-b45b-4eed-a7ed-bdccd5187fdf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:47.629658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63626-8283-4b1e-bc1d-b6915867f7f5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:47.653258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9caa-fc53-4bc5-961b-4f3aa833f293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:47.654245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9caa-fc53-4bc5-961b-4f3aa833f293 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.654598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9caa-fc53-4bc5-961b-4f3aa833f293 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.655018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c9caa-fc53-4bc5-961b-4f3aa833f293 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.656189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c9caa-fc53-4bc5-961b-4f3aa833f293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:47.656663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c9caa-fc53-4bc5-961b-4f3aa833f293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:47.658942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c9caa-fc53-4bc5-961b-4f3aa833f293 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:47.681416 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb830ae-bc63-487d-b4ca-5e82696aef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:47.682484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb830ae-bc63-487d-b4ca-5e82696aef8e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.682943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb830ae-bc63-487d-b4ca-5e82696aef8e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.683424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb830ae-bc63-487d-b4ca-5e82696aef8e None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.684956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb830ae-bc63-487d-b4ca-5e82696aef8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:47.685277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb830ae-bc63-487d-b4ca-5e82696aef8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:47.686770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb830ae-bc63-487d-b4ca-5e82696aef8e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:47.688052 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 231/470] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:47.688940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9caa-fc53-4bc5-961b-4f3aa833f293 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:47.700733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 240/471] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:47.702205 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd47b6-0b6c-48cb-a99f-86223f3446c0 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.702488 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd47b6-0b6c-48cb-a99f-86223f3446c0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.702767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd47b6-0b6c-48cb-a99f-86223f3446c0 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.704315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 241/472] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:47.704920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd47b6-0b6c-48cb-a99f-86223f3446c0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:47.790926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:47.841483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c9caa-fc53-4bc5-961b-4f3aa833f293 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:47.851336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd47b6-0b6c-48cb-a99f-86223f3446c0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:47.862616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:47.879585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505619c9-93ea-4a30-969c-531d22dbfabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:47.880545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505619c9-93ea-4a30-969c-531d22dbfabf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.880862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505619c9-93ea-4a30-969c-531d22dbfabf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.881170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505619c9-93ea-4a30-969c-531d22dbfabf None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.882396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505619c9-93ea-4a30-969c-531d22dbfabf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:47.882747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505619c9-93ea-4a30-969c-531d22dbfabf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:47.884290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505619c9-93ea-4a30-969c-531d22dbfabf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:47.895988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4e0e-fd5c-4df3-886e-4452bfdb41eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:47.901272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 232/473] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:47.901435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4e0e-fd5c-4df3-886e-4452bfdb41eb None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.901435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4e0e-fd5c-4df3-886e-4452bfdb41eb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.901435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4e0e-fd5c-4df3-886e-4452bfdb41eb None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.901435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4e0e-fd5c-4df3-886e-4452bfdb41eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:47.901686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505619c9-93ea-4a30-969c-531d22dbfabf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:47.901752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4e0e-fd5c-4df3-886e-4452bfdb41eb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:47.930219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 242/474] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:43:47 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:43:47.930219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aef27-c670-4d50-98ea-bc50b7155000 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:47.930219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aef27-c670-4d50-98ea-bc50b7155000 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:47.930219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aef27-c670-4d50-98ea-bc50b7155000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:47.959923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e35aef27-c670-4d50-98ea-bc50b7155000 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:47.961268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e35aef27-c670-4d50-98ea-bc50b7155000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:48.026508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505619c9-93ea-4a30-969c-531d22dbfabf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:48.065946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:48.066339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 243/475] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:48.067323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35aef27-c670-4d50-98ea-bc50b7155000 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:48.094016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5b61-1739-4062-acba-7650e141d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:48.094761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5b61-1739-4062-acba-7650e141d771 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:48.095047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5b61-1739-4062-acba-7650e141d771 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:48.095469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5b61-1739-4062-acba-7650e141d771 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:48.098158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5b61-1739-4062-acba-7650e141d771 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:48.100675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5b61-1739-4062-acba-7650e141d771 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:48.136285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 233/476] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:43:47 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:43:48.138067 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5b61-1739-4062-acba-7650e141d771 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:48.229925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:48.248513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35aef27-c670-4d50-98ea-bc50b7155000 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:48.299742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6cf2b-c24d-4e86-9c42-7e77f8e9d3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:48.302666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6cf2b-c24d-4e86-9c42-7e77f8e9d3d4 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:48.303572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6cf2b-c24d-4e86-9c42-7e77f8e9d3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:48.304113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6cf2b-c24d-4e86-9c42-7e77f8e9d3d4 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:48.305087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6cf2b-c24d-4e86-9c42-7e77f8e9d3d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:48.307745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6cf2b-c24d-4e86-9c42-7e77f8e9d3d4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:48.346115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 244/477] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:43:48 2022] POST /identity/v3/users => generated 249 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:43:48.351523 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5b61-1739-4062-acba-7650e141d771 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:48.402770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:48.403530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:48.403817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:48.404091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:48.404892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:48.407064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:48.414520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 12:43:48.414520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 12:43:48.414520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [parameters: {'id': 'b3d5f776f87546d4a9dca32705ee1aca', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 12:43:48.414520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Jun 17 12:43:48.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return ref.to_dict() Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 12:43:48.433503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 12:43:48.434483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 12:43:48.435389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 12:43:48.436258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 12:43:48.437070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'id': 'b3d5f776f87546d4a9dca32705ee1aca', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:48.437849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 12:43:48.440516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:48.442472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 234/478] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 12:43:48 2022] POST /identity/v3/roles => generated 144 bytes in 297 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:48.444070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6cf2b-c24d-4e86-9c42-7e77f8e9d3d4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:48.567607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6cf2b-c24d-4e86-9c42-7e77f8e9d3d4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:48.613640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b1e4f-bb26-471f-9c68-99781d0a0b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:48.615089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1e4f-bb26-471f-9c68-99781d0a0b4f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:48.615687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1e4f-bb26-471f-9c68-99781d0a0b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:48.616200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1e4f-bb26-471f-9c68-99781d0a0b4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:48.638643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b1e4f-bb26-471f-9c68-99781d0a0b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7d4b1e4f-bb26-471f-9c68-99781d0a0b4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:48.648486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:48.649446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:48.650302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 245/479] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:43:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:48.656068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:48.727629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:48.795733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa228f7-1818-4feb-a01e-2179e57b4bd5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:48.835243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3aceb-301f-4a18-a2b8-201b96fbce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:48.836327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3aceb-301f-4a18-a2b8-201b96fbce04 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:48.836832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3aceb-301f-4a18-a2b8-201b96fbce04 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:48.837308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3aceb-301f-4a18-a2b8-201b96fbce04 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:48.838321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3aceb-301f-4a18-a2b8-201b96fbce04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:48.838858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3aceb-301f-4a18-a2b8-201b96fbce04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:48.840488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3aceb-301f-4a18-a2b8-201b96fbce04 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:48.851087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 235/480] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:50.192881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f138-b721-40a6-bce6-683d2122edf9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:50.193806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f138-b721-40a6-bce6-683d2122edf9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:50.194120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f138-b721-40a6-bce6-683d2122edf9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:50.195801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 246/481] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:50.201753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7db31-1a88-4cec-a1a3-db835992832f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:50.202242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7db31-1a88-4cec-a1a3-db835992832f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:50.202469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7db31-1a88-4cec-a1a3-db835992832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:50.227172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-03c7db31-1a88-4cec-a1a3-db835992832f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:50.228415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-03c7db31-1a88-4cec-a1a3-db835992832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:50.315429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 236/482] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:50.360236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f138-b721-40a6-bce6-683d2122edf9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:50.375946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:50.521279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f138-b721-40a6-bce6-683d2122edf9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:50.577650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b190859-6295-4b50-bf63-eeedeb1cc2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:50.578790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b190859-6295-4b50-bf63-eeedeb1cc2ed None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:50.579207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b190859-6295-4b50-bf63-eeedeb1cc2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:50.579614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b190859-6295-4b50-bf63-eeedeb1cc2ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:50.601814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b190859-6295-4b50-bf63-eeedeb1cc2ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1b190859-6295-4b50-bf63-eeedeb1cc2ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:50.615701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:50.616651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:50.617437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 247/483] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:50.624425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7db31-1a88-4cec-a1a3-db835992832f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:50.687690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:50.766713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7db31-1a88-4cec-a1a3-db835992832f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:50.810554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60645d93-731c-44ad-8537-48d48a03524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:50.811273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60645d93-731c-44ad-8537-48d48a03524a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:50.811561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60645d93-731c-44ad-8537-48d48a03524a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:50.811891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60645d93-731c-44ad-8537-48d48a03524a None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:50.812702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60645d93-731c-44ad-8537-48d48a03524a None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:50.813013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60645d93-731c-44ad-8537-48d48a03524a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:50.814616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60645d93-731c-44ad-8537-48d48a03524a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:50.825118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 237/484] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:50.830735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b190859-6295-4b50-bf63-eeedeb1cc2ed None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:50.861158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9e8e-f5dc-4c08-8052-f22a92e83e84 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:50.861495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9e8e-f5dc-4c08-8052-f22a92e83e84 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:50.861730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9e8e-f5dc-4c08-8052-f22a92e83e84 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:50.863940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 238/485] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:50.869919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb8902-d73a-4297-a922-5499cc3bedef None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:50.870244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb8902-d73a-4297-a922-5499cc3bedef None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:50.870533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb8902-d73a-4297-a922-5499cc3bedef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:50.891051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0ecb8902-d73a-4297-a922-5499cc3bedef None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:50.892565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0ecb8902-d73a-4297-a922-5499cc3bedef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:50.965658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:51.002767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b190859-6295-4b50-bf63-eeedeb1cc2ed None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:51.052814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 239/486] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:43:51.053503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f00ef-ad2b-4226-a074-48b938ae9c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:51.054375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f00ef-ad2b-4226-a074-48b938ae9c5a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.054749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f00ef-ad2b-4226-a074-48b938ae9c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.055045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f00ef-ad2b-4226-a074-48b938ae9c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.075819 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb8902-d73a-4297-a922-5499cc3bedef None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:51.078762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f00ef-ad2b-4226-a074-48b938ae9c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:51.081384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f00ef-ad2b-4226-a074-48b938ae9c5a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3e1f00ef-ad2b-4226-a074-48b938ae9c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:51.124639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:51.125584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:51.126532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:51.126532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:51.126532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:51.126532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:51.126532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 248/487] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:51.134811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f00ef-ad2b-4226-a074-48b938ae9c5a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:51.154550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:51.251988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb8902-d73a-4297-a922-5499cc3bedef None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:51.294211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f00ef-ad2b-4226-a074-48b938ae9c5a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:51.297400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4b7ec-c2bd-4b0b-9c87-099d639bf350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:51.298286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4b7ec-c2bd-4b0b-9c87-099d639bf350 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.298572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4b7ec-c2bd-4b0b-9c87-099d639bf350 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.298858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4b7ec-c2bd-4b0b-9c87-099d639bf350 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.312916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4b7ec-c2bd-4b0b-9c87-099d639bf350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dec4b7ec-c2bd-4b0b-9c87-099d639bf350 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:51.321216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:51.322275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:51.323068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 240/488] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:51.325415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:51.329451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045c7c8-deb9-4cc6-ab00-cd1dd594d6e4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.329663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045c7c8-deb9-4cc6-ab00-cd1dd594d6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.329940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045c7c8-deb9-4cc6-ab00-cd1dd594d6e4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.334151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 241/489] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:51.334151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10626024-a999-46e3-9f19-fe40c5005c3a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.334151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10626024-a999-46e3-9f19-fe40c5005c3a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.334151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10626024-a999-46e3-9f19-fe40c5005c3a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.338555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 242/490] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:51.339458 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10626024-a999-46e3-9f19-fe40c5005c3a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:51.348393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75341bb8-2b91-444a-8bd0-f5eb650109e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:51.349235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75341bb8-2b91-444a-8bd0-f5eb650109e4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.349585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75341bb8-2b91-444a-8bd0-f5eb650109e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.350070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75341bb8-2b91-444a-8bd0-f5eb650109e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.350777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75341bb8-2b91-444a-8bd0-f5eb650109e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:51.351141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75341bb8-2b91-444a-8bd0-f5eb650109e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:51.352610 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75341bb8-2b91-444a-8bd0-f5eb650109e4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:51.367482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 249/491] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:51.368899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59f8eb-cf19-40c7-aae4-11c9c084891f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.369185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59f8eb-cf19-40c7-aae4-11c9c084891f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.369447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59f8eb-cf19-40c7-aae4-11c9c084891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.391690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fc59f8eb-cf19-40c7-aae4-11c9c084891f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:51.392878 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fc59f8eb-cf19-40c7-aae4-11c9c084891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:51.455060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:51.467972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10626024-a999-46e3-9f19-fe40c5005c3a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:51.470180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 250/492] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:51.471330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3dea7-6a26-4562-96fb-c72b27581305 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.471688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3dea7-6a26-4562-96fb-c72b27581305 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.471981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3dea7-6a26-4562-96fb-c72b27581305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.489296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a2e3dea7-6a26-4562-96fb-c72b27581305 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:51.490805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a2e3dea7-6a26-4562-96fb-c72b27581305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:51.517397 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f17e5b-58cb-4f3f-9cd7-04c05b53ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:51.518136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f17e5b-58cb-4f3f-9cd7-04c05b53ed73 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.518411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f17e5b-58cb-4f3f-9cd7-04c05b53ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.518717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f17e5b-58cb-4f3f-9cd7-04c05b53ed73 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.519486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f17e5b-58cb-4f3f-9cd7-04c05b53ed73 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:51.519798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f17e5b-58cb-4f3f-9cd7-04c05b53ed73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:51.521258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f17e5b-58cb-4f3f-9cd7-04c05b53ed73 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:51.530913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 243/493] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:51.531779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f17e5b-58cb-4f3f-9cd7-04c05b53ed73 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:51.598340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 251/494] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:51.600728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3dea7-6a26-4562-96fb-c72b27581305 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:51.656520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:51.677109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f17e5b-58cb-4f3f-9cd7-04c05b53ed73 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:51.725925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3dea7-6a26-4562-96fb-c72b27581305 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:51.744542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d5a7-c563-4435-b424-4a0e989ea8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:51.746222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d5a7-c563-4435-b424-4a0e989ea8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.746533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d5a7-c563-4435-b424-4a0e989ea8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.747032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d5a7-c563-4435-b424-4a0e989ea8d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.762021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0d5a7-c563-4435-b424-4a0e989ea8d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:51.763792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0d5a7-c563-4435-b424-4a0e989ea8d7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dad0d5a7-c563-4435-b424-4a0e989ea8d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:43:51.783086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:51.784377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:51.785349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 244/495] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 12:43:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:51.787220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d5a7-c563-4435-b424-4a0e989ea8d7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:51.790366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc6fcd-88a6-4761-bf34-1ac10f825c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:51.791258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc6fcd-88a6-4761-bf34-1ac10f825c26 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.791545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc6fcd-88a6-4761-bf34-1ac10f825c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.791832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc6fcd-88a6-4761-bf34-1ac10f825c26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:51.808525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc6fcd-88a6-4761-bf34-1ac10f825c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:51.810807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-63bc6fcd-88a6-4761-bf34-1ac10f825c26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:51.817364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:51.819124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 252/496] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:51.820475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc6fcd-88a6-4761-bf34-1ac10f825c26 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:51.955007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d5a7-c563-4435-b424-4a0e989ea8d7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:51.964777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:51.968855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc6fcd-88a6-4761-bf34-1ac10f825c26 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:51.996447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ec0b9-b850-474b-be10-a586e0ab59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:51.997378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ec0b9-b850-474b-be10-a586e0ab59c1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:51.997540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ec0b9-b850-474b-be10-a586e0ab59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:51.997863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ec0b9-b850-474b-be10-a586e0ab59c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.008112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cba1a-812a-4ee8-ab2d-9031fe99ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:52.009210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cba1a-812a-4ee8-ab2d-9031fe99ce4b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.009580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cba1a-812a-4ee8-ab2d-9031fe99ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.009897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ec0b9-b850-474b-be10-a586e0ab59c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:52.010058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cba1a-812a-4ee8-ab2d-9031fe99ce4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.011486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ec0b9-b850-474b-be10-a586e0ab59c1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:52.022130 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cba1a-812a-4ee8-ab2d-9031fe99ce4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5d4ec0b9-b850-474b-be10-a586e0ab59c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:52.030017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:52.030939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:52.031833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:52.031833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:52.031833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:52.031833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f03cba1a-812a-4ee8-ab2d-9031fe99ce4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:52.032066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:52.033869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 253/497] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:52.035771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cba1a-812a-4ee8-ab2d-9031fe99ce4b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.037176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 245/498] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:52.037692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ec0b9-b850-474b-be10-a586e0ab59c1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.108891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:52.148537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cba1a-812a-4ee8-ab2d-9031fe99ce4b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:52.149084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ec0b9-b850-474b-be10-a586e0ab59c1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:52.183670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea57482-8a82-435e-9363-5c9eabb28689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:52.183932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b0109-bc43-4122-bfb5-98de0b5311e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:52.184346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea57482-8a82-435e-9363-5c9eabb28689 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.184481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b0109-bc43-4122-bfb5-98de0b5311e9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.184634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea57482-8a82-435e-9363-5c9eabb28689 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.184754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b0109-bc43-4122-bfb5-98de0b5311e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.184878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea57482-8a82-435e-9363-5c9eabb28689 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.185001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b0109-bc43-4122-bfb5-98de0b5311e9 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.185642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea57482-8a82-435e-9363-5c9eabb28689 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:52.185779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b0109-bc43-4122-bfb5-98de0b5311e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:52.185958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea57482-8a82-435e-9363-5c9eabb28689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:52.186081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b0109-bc43-4122-bfb5-98de0b5311e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:52.187404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea57482-8a82-435e-9363-5c9eabb28689 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:52.187506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b0109-bc43-4122-bfb5-98de0b5311e9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:52.196112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 246/499] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:52.197382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617fac0-a0f0-43e1-b217-f7f9c216a57a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.197668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617fac0-a0f0-43e1-b217-f7f9c216a57a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.197945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617fac0-a0f0-43e1-b217-f7f9c216a57a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.199489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 247/500] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:52.200191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617fac0-a0f0-43e1-b217-f7f9c216a57a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.230700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 254/501] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:52.232015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b0109-bc43-4122-bfb5-98de0b5311e9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.256726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:52.332460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617fac0-a0f0-43e1-b217-f7f9c216a57a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:52.349470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b0109-bc43-4122-bfb5-98de0b5311e9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:52.360868 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:52.370490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7811bdd-af4f-446b-8dab-4df3a8079d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:52.371176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7811bdd-af4f-446b-8dab-4df3a8079d8d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.371467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7811bdd-af4f-446b-8dab-4df3a8079d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.371750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7811bdd-af4f-446b-8dab-4df3a8079d8d None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.372494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7811bdd-af4f-446b-8dab-4df3a8079d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:52.372834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7811bdd-af4f-446b-8dab-4df3a8079d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:52.374262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7811bdd-af4f-446b-8dab-4df3a8079d8d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:52.387563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 248/502] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:52.388433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7811bdd-af4f-446b-8dab-4df3a8079d8d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.389917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276e990-ebb4-4ae7-a46b-cb133c2e0226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:52.390707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276e990-ebb4-4ae7-a46b-cb133c2e0226 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.391050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276e990-ebb4-4ae7-a46b-cb133c2e0226 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.391410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276e990-ebb4-4ae7-a46b-cb133c2e0226 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.392168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276e990-ebb4-4ae7-a46b-cb133c2e0226 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:52.392473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276e990-ebb4-4ae7-a46b-cb133c2e0226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:52.393901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276e990-ebb4-4ae7-a46b-cb133c2e0226 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:52.402898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 255/503] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:52.403953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af514e35-0e19-4b6f-8abf-9b31f3d7b35d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.404236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af514e35-0e19-4b6f-8abf-9b31f3d7b35d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.404505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af514e35-0e19-4b6f-8abf-9b31f3d7b35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.421309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-af514e35-0e19-4b6f-8abf-9b31f3d7b35d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:52.422559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-af514e35-0e19-4b6f-8abf-9b31f3d7b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:52.493051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 256/504] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:52.494325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af514e35-0e19-4b6f-8abf-9b31f3d7b35d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.499195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7811bdd-af4f-446b-8dab-4df3a8079d8d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:52.511504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:52.536755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018a4e-4c20-4d89-b455-ddaa84eb3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:52.537764 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018a4e-4c20-4d89-b455-ddaa84eb3355 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.538040 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018a4e-4c20-4d89-b455-ddaa84eb3355 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.538374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018a4e-4c20-4d89-b455-ddaa84eb3355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.548718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71018a4e-4c20-4d89-b455-ddaa84eb3355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:52.550341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71018a4e-4c20-4d89-b455-ddaa84eb3355 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-71018a4e-4c20-4d89-b455-ddaa84eb3355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:52.569992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:52.571124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:52.572042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:52.572042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:52.572042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:52.572042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:52.572042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 249/505] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:52.572324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018a4e-4c20-4d89-b455-ddaa84eb3355 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.619799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af514e35-0e19-4b6f-8abf-9b31f3d7b35d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:52.622532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:52.655299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f11b08-917a-4dc1-9068-71e0642b1029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:52.655962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11b08-917a-4dc1-9068-71e0642b1029 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.656242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11b08-917a-4dc1-9068-71e0642b1029 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.656521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11b08-917a-4dc1-9068-71e0642b1029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.683770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018a4e-4c20-4d89-b455-ddaa84eb3355 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:52.719772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c664854-fa45-4040-8705-70a9b8a62c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:52.720616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c664854-fa45-4040-8705-70a9b8a62c26 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.720892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c664854-fa45-4040-8705-70a9b8a62c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.721172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c664854-fa45-4040-8705-70a9b8a62c26 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.727858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f11b08-917a-4dc1-9068-71e0642b1029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:52.729422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f11b08-917a-4dc1-9068-71e0642b1029 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:52.730020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c664854-fa45-4040-8705-70a9b8a62c26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:52.731556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c664854-fa45-4040-8705-70a9b8a62c26 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:52.743035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2c664854-fa45-4040-8705-70a9b8a62c26 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:43:52.748323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:52.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 250/506] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:52.750394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c664854-fa45-4040-8705-70a9b8a62c26 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.853553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 257/507] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:52.854471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f11b08-917a-4dc1-9068-71e0642b1029 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.856083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:52.860719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c664854-fa45-4040-8705-70a9b8a62c26 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:52.902480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5dcfb-6911-4530-b039-7a97f8a7e5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:52.903305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5dcfb-6911-4530-b039-7a97f8a7e5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:52.903588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5dcfb-6911-4530-b039-7a97f8a7e5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:52.903871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5dcfb-6911-4530-b039-7a97f8a7e5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:52.915791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5dcfb-6911-4530-b039-7a97f8a7e5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:52.917299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5dcfb-6911-4530-b039-7a97f8a7e5c0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5ca5dcfb-6911-4530-b039-7a97f8a7e5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:52.935992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:52.936984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:52.937824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:52.937824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:52.937824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:52.937824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:52.937824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 251/508] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:52.938645 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5dcfb-6911-4530-b039-7a97f8a7e5c0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:52.968386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f11b08-917a-4dc1-9068-71e0642b1029 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:52.980539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:53.011927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834dc37-cf1d-4a30-b88b-9c5f5e1fd384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.013131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834dc37-cf1d-4a30-b88b-9c5f5e1fd384 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.013417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834dc37-cf1d-4a30-b88b-9c5f5e1fd384 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.013702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834dc37-cf1d-4a30-b88b-9c5f5e1fd384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.027257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834dc37-cf1d-4a30-b88b-9c5f5e1fd384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.028893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834dc37-cf1d-4a30-b88b-9c5f5e1fd384 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.047603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5dcfb-6911-4530-b039-7a97f8a7e5c0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5834dc37-cf1d-4a30-b88b-9c5f5e1fd384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:53.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:53.049516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:53.050653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:53.050653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:53.050653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:53.050653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:53.050653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 258/509] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:53.050653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834dc37-cf1d-4a30-b88b-9c5f5e1fd384 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:53.100273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ff155-0a74-49d9-8b15-3b964d0619d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.100957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ff155-0a74-49d9-8b15-3b964d0619d5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.101245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ff155-0a74-49d9-8b15-3b964d0619d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.101529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ff155-0a74-49d9-8b15-3b964d0619d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.102299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ff155-0a74-49d9-8b15-3b964d0619d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:53.102604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ff155-0a74-49d9-8b15-3b964d0619d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.104037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ff155-0a74-49d9-8b15-3b964d0619d5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.121997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 252/510] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:53.121997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ff155-0a74-49d9-8b15-3b964d0619d5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:53.135927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:53.172013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834dc37-cf1d-4a30-b88b-9c5f5e1fd384 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:53.214817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43df13-6430-4482-a9b1-fb6ce0219ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.215532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43df13-6430-4482-a9b1-fb6ce0219ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.215799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43df13-6430-4482-a9b1-fb6ce0219ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.216095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43df13-6430-4482-a9b1-fb6ce0219ab7 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.216982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43df13-6430-4482-a9b1-fb6ce0219ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:53.217287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43df13-6430-4482-a9b1-fb6ce0219ab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.218917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43df13-6430-4482-a9b1-fb6ce0219ab7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.238519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ff155-0a74-49d9-8b15-3b964d0619d5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:53.240288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 259/511] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 12:43:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:53.241392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43df13-6430-4482-a9b1-fb6ce0219ab7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:53.265888 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:53.278573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ee5d7-f73b-4f14-81a2-7bf92e4b7ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.279401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ee5d7-f73b-4f14-81a2-7bf92e4b7ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.279666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ee5d7-f73b-4f14-81a2-7bf92e4b7ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.279944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ee5d7-f73b-4f14-81a2-7bf92e4b7ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.291766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ee5d7-f73b-4f14-81a2-7bf92e4b7ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.294568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ee5d7-f73b-4f14-81a2-7bf92e4b7ef3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-770ee5d7-f73b-4f14-81a2-7bf92e4b7ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:53.315506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:53.316554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:53.317536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:53.317536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:53.317536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:53.317536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:53.317536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 253/512] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:53.323555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ee5d7-f73b-4f14-81a2-7bf92e4b7ef3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:53.352489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43df13-6430-4482-a9b1-fb6ce0219ab7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:53.404682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:53.406703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871201f-1b4d-420d-bcaf-6f695adf4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.407569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871201f-1b4d-420d-bcaf-6f695adf4107 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.407918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871201f-1b4d-420d-bcaf-6f695adf4107 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.408258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871201f-1b4d-420d-bcaf-6f695adf4107 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.409180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871201f-1b4d-420d-bcaf-6f695adf4107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:53.409563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871201f-1b4d-420d-bcaf-6f695adf4107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.411712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871201f-1b4d-420d-bcaf-6f695adf4107 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.428080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 260/513] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:53.429286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871201f-1b4d-420d-bcaf-6f695adf4107 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:53.453307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ee5d7-f73b-4f14-81a2-7bf92e4b7ef3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:53.499217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bb50a-dfb8-4541-8dca-460f69051d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.500520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bb50a-dfb8-4541-8dca-460f69051d01 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.500961 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bb50a-dfb8-4541-8dca-460f69051d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.501672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bb50a-dfb8-4541-8dca-460f69051d01 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.503284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bb50a-dfb8-4541-8dca-460f69051d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:53.503777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bb50a-dfb8-4541-8dca-460f69051d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.508238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bb50a-dfb8-4541-8dca-460f69051d01 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.521149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:53.526232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 254/514] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:53.527107 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bb50a-dfb8-4541-8dca-460f69051d01 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:53.548537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871201f-1b4d-420d-bcaf-6f695adf4107 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:53.588072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5389c1-4b84-461e-8733-a7ea10b586f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.589115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5389c1-4b84-461e-8733-a7ea10b586f8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.589587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5389c1-4b84-461e-8733-a7ea10b586f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.589991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5389c1-4b84-461e-8733-a7ea10b586f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.598610 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5389c1-4b84-461e-8733-a7ea10b586f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.600651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5389c1-4b84-461e-8733-a7ea10b586f8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ab5389c1-4b84-461e-8733-a7ea10b586f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:43:53.618345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:53.619438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 261/515] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:43:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:53.625764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5389c1-4b84-461e-8733-a7ea10b586f8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:53.647425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bb50a-dfb8-4541-8dca-460f69051d01 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:53.683522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:53.697220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f81714-e589-4204-9161-99d77483a7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.698846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f81714-e589-4204-9161-99d77483a7af None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.698846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f81714-e589-4204-9161-99d77483a7af None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.698846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f81714-e589-4204-9161-99d77483a7af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.731624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5389c1-4b84-461e-8733-a7ea10b586f8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:53.779982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a25f26-f148-417e-96de-09811a823607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.780624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a25f26-f148-417e-96de-09811a823607 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.780804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f81714-e589-4204-9161-99d77483a7af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.780958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a25f26-f148-417e-96de-09811a823607 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.781162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a25f26-f148-417e-96de-09811a823607 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.781881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a25f26-f148-417e-96de-09811a823607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:53.782204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a25f26-f148-417e-96de-09811a823607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.782322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f81714-e589-4204-9161-99d77483a7af None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.783648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a25f26-f148-417e-96de-09811a823607 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.793238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:53.798480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 262/516] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:53.799368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a25f26-f148-417e-96de-09811a823607 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:53.892602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 255/517] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:53.893488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f81714-e589-4204-9161-99d77483a7af None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:53.903935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a25f26-f148-417e-96de-09811a823607 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:53.920708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:53.951779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007481e-078c-4274-882e-e997b2ab4a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:53.952739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007481e-078c-4274-882e-e997b2ab4a7c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:53.953100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007481e-078c-4274-882e-e997b2ab4a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:53.953458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007481e-078c-4274-882e-e997b2ab4a7c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:53.964157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007481e-078c-4274-882e-e997b2ab4a7c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:53.966708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007481e-078c-4274-882e-e997b2ab4a7c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5007481e-078c-4274-882e-e997b2ab4a7c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:43:53.993359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:53.994425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 12:43:53.995313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:53.995821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 263/518] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:43:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:53.996737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007481e-078c-4274-882e-e997b2ab4a7c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:54.036015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f81714-e589-4204-9161-99d77483a7af None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:54.071584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b46f13-ae8a-44fe-afde-8233bc45af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:54.072305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b46f13-ae8a-44fe-afde-8233bc45af6c None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:54.072631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b46f13-ae8a-44fe-afde-8233bc45af6c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:54.072866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b46f13-ae8a-44fe-afde-8233bc45af6c None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:54.073635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b46f13-ae8a-44fe-afde-8233bc45af6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:54.075219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b46f13-ae8a-44fe-afde-8233bc45af6c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:54.075750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:54.096777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 256/519] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:43:53 2022] POST /identity/v3/users => generated 247 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:43:54.097606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b46f13-ae8a-44fe-afde-8233bc45af6c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:54.126357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007481e-078c-4274-882e-e997b2ab4a7c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:54.171077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7c8dd-ec3d-47cd-931a-410ac574b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:54.171785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7c8dd-ec3d-47cd-931a-410ac574b9ef None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:54.172073 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7c8dd-ec3d-47cd-931a-410ac574b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:54.172354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7c8dd-ec3d-47cd-931a-410ac574b9ef None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:54.173221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7c8dd-ec3d-47cd-931a-410ac574b9ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:54.173541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7c8dd-ec3d-47cd-931a-410ac574b9ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:54.175139 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7c8dd-ec3d-47cd-931a-410ac574b9ef None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:54.198736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 264/520] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 12:43:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:54.200033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7c8dd-ec3d-47cd-931a-410ac574b9ef None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:54.226418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:54.255591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b46f13-ae8a-44fe-afde-8233bc45af6c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:54.301418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a059f8-c810-48f1-8c63-27af113faa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:54.302372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a059f8-c810-48f1-8c63-27af113faa43 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:54.302701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a059f8-c810-48f1-8c63-27af113faa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:54.302943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a059f8-c810-48f1-8c63-27af113faa43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:54.314987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a059f8-c810-48f1-8c63-27af113faa43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:54.317805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a059f8-c810-48f1-8c63-27af113faa43 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:54.331913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7c8dd-ec3d-47cd-931a-410ac574b9ef None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-68a059f8-c810-48f1-8c63-27af113faa43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:43:54.336561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:54.337485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 257/521] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:54.338682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a059f8-c810-48f1-8c63-27af113faa43 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:54.356305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:54.379322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e13e0e-0cab-4a33-aed8-8bf24703854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:54.380269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e13e0e-0cab-4a33-aed8-8bf24703854d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:54.380639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e13e0e-0cab-4a33-aed8-8bf24703854d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:54.380920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e13e0e-0cab-4a33-aed8-8bf24703854d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:54.395579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e13e0e-0cab-4a33-aed8-8bf24703854d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:54.397132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e13e0e-0cab-4a33-aed8-8bf24703854d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c4e13e0e-0cab-4a33-aed8-8bf24703854d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:54.419134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:54.420050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:54.420874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:54.420874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:54.420874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:54.420874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:54.421676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 265/522] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:54.423361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e13e0e-0cab-4a33-aed8-8bf24703854d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:54.517236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a059f8-c810-48f1-8c63-27af113faa43 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:54.562043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269878a-3db4-442c-bef8-79d92e73ac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:54.562681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269878a-3db4-442c-bef8-79d92e73ac48 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:54.562800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e13e0e-0cab-4a33-aed8-8bf24703854d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:54.562973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269878a-3db4-442c-bef8-79d92e73ac48 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:54.563230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269878a-3db4-442c-bef8-79d92e73ac48 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:54.564146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269878a-3db4-442c-bef8-79d92e73ac48 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:54.564451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269878a-3db4-442c-bef8-79d92e73ac48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:54.566079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269878a-3db4-442c-bef8-79d92e73ac48 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:54.599857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:54.617968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c1bf4-753c-42e4-8038-bfeb4ff07dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:54.618704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c1bf4-753c-42e4-8038-bfeb4ff07dfb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:54.618993 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c1bf4-753c-42e4-8038-bfeb4ff07dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:54.619274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c1bf4-753c-42e4-8038-bfeb4ff07dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:54.620682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 258/523] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Jun 17 12:43:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:54.621963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269878a-3db4-442c-bef8-79d92e73ac48 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:54.687127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:54.728701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c1bf4-753c-42e4-8038-bfeb4ff07dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:54.730535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c1bf4-753c-42e4-8038-bfeb4ff07dfb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:54.759468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269878a-3db4-442c-bef8-79d92e73ac48 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:54.798111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb34bdb-f484-4728-9d62-066e5d724984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:54.798818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb34bdb-f484-4728-9d62-066e5d724984 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:54.799118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb34bdb-f484-4728-9d62-066e5d724984 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:54.799380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb34bdb-f484-4728-9d62-066e5d724984 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:54.800208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb34bdb-f484-4728-9d62-066e5d724984 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:54.800507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb34bdb-f484-4728-9d62-066e5d724984 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:54.802561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb34bdb-f484-4728-9d62-066e5d724984 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:54.835523 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 259/524] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:54.835523 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb34bdb-f484-4728-9d62-066e5d724984 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:54.867539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 266/525] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:54.867539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c1bf4-753c-42e4-8038-bfeb4ff07dfb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:54.922375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:54.959174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:54.974369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb34bdb-f484-4728-9d62-066e5d724984 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:55.001397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c1bf4-753c-42e4-8038-bfeb4ff07dfb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:55.013813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871b698-c7c9-4504-b3c2-69fd0bef2c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:55.014528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871b698-c7c9-4504-b3c2-69fd0bef2c46 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:55.014814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871b698-c7c9-4504-b3c2-69fd0bef2c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:55.015105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871b698-c7c9-4504-b3c2-69fd0bef2c46 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:55.015915 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871b698-c7c9-4504-b3c2-69fd0bef2c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:55.016215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871b698-c7c9-4504-b3c2-69fd0bef2c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:55.017689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871b698-c7c9-4504-b3c2-69fd0bef2c46 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:55.034979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 260/526] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:55.034979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871b698-c7c9-4504-b3c2-69fd0bef2c46 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:55.053902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd659-e3c5-45f3-86b8-c9d701a9af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:55.054633 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd659-e3c5-45f3-86b8-c9d701a9af39 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:55.055045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd659-e3c5-45f3-86b8-c9d701a9af39 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:55.055446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd659-e3c5-45f3-86b8-c9d701a9af39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:55.137526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd659-e3c5-45f3-86b8-c9d701a9af39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:55.139067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd659-e3c5-45f3-86b8-c9d701a9af39 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:55.163589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871b698-c7c9-4504-b3c2-69fd0bef2c46 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:55.187891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:55.213076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432ebb-3bb0-4563-969a-caae47aaf9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:55.213768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432ebb-3bb0-4563-969a-caae47aaf9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:55.214127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432ebb-3bb0-4563-969a-caae47aaf9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:55.215026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9432ebb-3bb0-4563-969a-caae47aaf9b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:55.215310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9432ebb-3bb0-4563-969a-caae47aaf9b3 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=09a967d14a7243068a016b4677e47234) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:55.215628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9432ebb-3bb0-4563-969a-caae47aaf9b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:55.217241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9432ebb-3bb0-4563-969a-caae47aaf9b3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:55.223175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:55.230638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 261/527] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:55 2022] GET /identity/v3/role_assignments?user.id=09a967d14a7243068a016b4677e47234&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:55.230638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432ebb-3bb0-4563-969a-caae47aaf9b3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:55.292583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 267/528] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:43:55.293615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd659-e3c5-45f3-86b8-c9d701a9af39 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:55.408393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9432ebb-3bb0-4563-969a-caae47aaf9b3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:55.451496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd659-e3c5-45f3-86b8-c9d701a9af39 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:55.460608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ad304-e942-4833-bfe8-d94340b8c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:55.461540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ad304-e942-4833-bfe8-d94340b8c7eb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:55.461928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ad304-e942-4833-bfe8-d94340b8c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:55.462389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ad304-e942-4833-bfe8-d94340b8c7eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:55.479830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ad304-e942-4833-bfe8-d94340b8c7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:55.482220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ad304-e942-4833-bfe8-d94340b8c7eb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:55.491376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6374f5-809a-4ffa-b532-494269ad3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:55.493004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6374f5-809a-4ffa-b532-494269ad3426 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:55.493374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6374f5-809a-4ffa-b532-494269ad3426 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:55.493713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6374f5-809a-4ffa-b532-494269ad3426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:55.502081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6374f5-809a-4ffa-b532-494269ad3426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:55.504217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6374f5-809a-4ffa-b532-494269ad3426 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d52ad304-e942-4833-bfe8-d94340b8c7eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:55.508862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:55.509792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:55.510685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:55.510685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:55.510685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:55.510685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:55.517242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 262/529] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:55.518520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ad304-e942-4833-bfe8-d94340b8c7eb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-bc6374f5-809a-4ffa-b532-494269ad3426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:43:55.527740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:55.528928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:55.529922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:43:55.529922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:43:55.529922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:43:55.529922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:43:55.529922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:43:55.529922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:43:55.529922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:55.529922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:55.534276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 268/530] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:55.535596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6374f5-809a-4ffa-b532-494269ad3426 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:55.570780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:55.583843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:55.661112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6374f5-809a-4ffa-b532-494269ad3426 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:55.663239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ad304-e942-4833-bfe8-d94340b8c7eb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:55.696598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da5030-8b0d-49d7-babb-7abc974b7ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:55.697292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da5030-8b0d-49d7-babb-7abc974b7ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:55.697580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da5030-8b0d-49d7-babb-7abc974b7ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:55.697866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da5030-8b0d-49d7-babb-7abc974b7ea1 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:55.698650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da5030-8b0d-49d7-babb-7abc974b7ea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:55.698962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da5030-8b0d-49d7-babb-7abc974b7ea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:55.700412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da5030-8b0d-49d7-babb-7abc974b7ea1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:55.706227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1e1e5-eb43-4112-9193-537f2e76e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:55.708086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1e1e5-eb43-4112-9193-537f2e76e905 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:55.709027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1e1e5-eb43-4112-9193-537f2e76e905 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:55.709774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1e1e5-eb43-4112-9193-537f2e76e905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:55.718830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 269/531] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:55.719405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da5030-8b0d-49d7-babb-7abc974b7ea1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:55.723665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1e1e5-eb43-4112-9193-537f2e76e905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:55.725482 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1e1e5-eb43-4112-9193-537f2e76e905 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d5a1e1e5-eb43-4112-9193-537f2e76e905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:55.750342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:55.751248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:55.752118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:55.752118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:55.752118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:55.752118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:55.760299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 263/532] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:55.761656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1e1e5-eb43-4112-9193-537f2e76e905 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:55.828223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:55.841820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da5030-8b0d-49d7-babb-7abc974b7ea1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:55.861713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:55.881103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1e1e5-eb43-4112-9193-537f2e76e905 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:55.885883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59398f-e8c6-4bb6-b3cb-08f77d913520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:55.887449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59398f-e8c6-4bb6-b3cb-08f77d913520 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:55.887449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59398f-e8c6-4bb6-b3cb-08f77d913520 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:55.887449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59398f-e8c6-4bb6-b3cb-08f77d913520 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:55.888035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59398f-e8c6-4bb6-b3cb-08f77d913520 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:55.888351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59398f-e8c6-4bb6-b3cb-08f77d913520 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:55.889842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59398f-e8c6-4bb6-b3cb-08f77d913520 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:55.917057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 270/533] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:55.917057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59398f-e8c6-4bb6-b3cb-08f77d913520 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:55.934877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed667f-d422-4420-8490-e6c8e8ab9d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:55.936152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed667f-d422-4420-8490-e6c8e8ab9d7d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:55.936644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed667f-d422-4420-8490-e6c8e8ab9d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:55.937217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed667f-d422-4420-8490-e6c8e8ab9d7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:55.945460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed667f-d422-4420-8490-e6c8e8ab9d7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:55.947358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed667f-d422-4420-8490-e6c8e8ab9d7d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-92ed667f-d422-4420-8490-e6c8e8ab9d7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:43:55.963229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:55.964146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:55.965104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:43:55.965104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:43:55.965104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:43:55.965104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:43:55.965104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:43:55.965104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:43:55.965104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:55.965104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:55.968316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 264/534] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:55.969425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed667f-d422-4420-8490-e6c8e8ab9d7d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:56.018979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59398f-e8c6-4bb6-b3cb-08f77d913520 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:56.057148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c30f36-5dcf-4295-846b-3fa3c5aff5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:56.057850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c30f36-5dcf-4295-846b-3fa3c5aff5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.058162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c30f36-5dcf-4295-846b-3fa3c5aff5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.058443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c30f36-5dcf-4295-846b-3fa3c5aff5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.059190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c30f36-5dcf-4295-846b-3fa3c5aff5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:56.060945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c30f36-5dcf-4295-846b-3fa3c5aff5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:56.064387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c30f36-5dcf-4295-846b-3fa3c5aff5a9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:56.082186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 271/535] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:56.082186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c30f36-5dcf-4295-846b-3fa3c5aff5a9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:56.088477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed667f-d422-4420-8490-e6c8e8ab9d7d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:56.102951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:56.129895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac80d4-2b1a-44dc-9285-3d2732faf4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:56.131137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac80d4-2b1a-44dc-9285-3d2732faf4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.131639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac80d4-2b1a-44dc-9285-3d2732faf4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.132122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac80d4-2b1a-44dc-9285-3d2732faf4d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.133174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac80d4-2b1a-44dc-9285-3d2732faf4d4 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=984780a6a8df405dbbb2ba4c46dd841c) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:56.133681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac80d4-2b1a-44dc-9285-3d2732faf4d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:56.135636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac80d4-2b1a-44dc-9285-3d2732faf4d4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:56.142244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 265/536] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:55 2022] GET /identity/v3/role_assignments?user.id=984780a6a8df405dbbb2ba4c46dd841c&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:56.143436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac80d4-2b1a-44dc-9285-3d2732faf4d4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:56.161974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:56.197143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c30f36-5dcf-4295-846b-3fa3c5aff5a9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:56.252574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6940c4-6d78-4be5-829f-683fda2eb440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:56.253698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6940c4-6d78-4be5-829f-683fda2eb440 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.254276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6940c4-6d78-4be5-829f-683fda2eb440 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.254698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6940c4-6d78-4be5-829f-683fda2eb440 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.255868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6940c4-6d78-4be5-829f-683fda2eb440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:56.256439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6940c4-6d78-4be5-829f-683fda2eb440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:56.258240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6940c4-6d78-4be5-829f-683fda2eb440 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:56.272798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac80d4-2b1a-44dc-9285-3d2732faf4d4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:56.291328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 272/537] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:43:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:56.298153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6940c4-6d78-4be5-829f-683fda2eb440 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:56.322187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffae57-4a55-4371-87fc-dbfbe54e690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:56.324914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffae57-4a55-4371-87fc-dbfbe54e690c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.325197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffae57-4a55-4371-87fc-dbfbe54e690c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.325474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffae57-4a55-4371-87fc-dbfbe54e690c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.344489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffae57-4a55-4371-87fc-dbfbe54e690c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:56.346012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffae57-4a55-4371-87fc-dbfbe54e690c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-00ffae57-4a55-4371-87fc-dbfbe54e690c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:43:56.372157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:56.373083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:56.373926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:43:56.373926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:43:56.373926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:43:56.373926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:43:56.373926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:43:56.373926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:43:56.373926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:56.373926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:56.373926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 266/538] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:56.383182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46419-cf84-450b-a08a-252beb8d3243 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.383886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46419-cf84-450b-a08a-252beb8d3243 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.384174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46419-cf84-450b-a08a-252beb8d3243 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.387059 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 267/539] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:43:56.390193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46419-cf84-450b-a08a-252beb8d3243 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:56.420570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:56.454347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6940c4-6d78-4be5-829f-683fda2eb440 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:56.479560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:56.500407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddae451-fbbc-4341-bc35-dbdd596d2771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:56.501517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddae451-fbbc-4341-bc35-dbdd596d2771 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.502021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddae451-fbbc-4341-bc35-dbdd596d2771 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.502524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddae451-fbbc-4341-bc35-dbdd596d2771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.503654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddae451-fbbc-4341-bc35-dbdd596d2771 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=68fc7c689f3645149d927663730bab5e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:56.504167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddae451-fbbc-4341-bc35-dbdd596d2771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:56.506309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddae451-fbbc-4341-bc35-dbdd596d2771 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:56.518256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 273/540] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:56 2022] GET /identity/v3/role_assignments?user.id=68fc7c689f3645149d927663730bab5e&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:43:56.518256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25a71e-4f20-45e9-894c-da7c2e057789 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.518256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25a71e-4f20-45e9-894c-da7c2e057789 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.518256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25a71e-4f20-45e9-894c-da7c2e057789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.520611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46419-cf84-450b-a08a-252beb8d3243 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:56.563756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7c25a71e-4f20-45e9-894c-da7c2e057789 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:56.565650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c25a71e-4f20-45e9-894c-da7c2e057789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:56.627784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12af6bf-a11b-405d-8763-1b4fc2cee106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:56.629028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12af6bf-a11b-405d-8763-1b4fc2cee106 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.629311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12af6bf-a11b-405d-8763-1b4fc2cee106 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.629584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12af6bf-a11b-405d-8763-1b4fc2cee106 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.630992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12af6bf-a11b-405d-8763-1b4fc2cee106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:56.631360 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12af6bf-a11b-405d-8763-1b4fc2cee106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:56.632969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12af6bf-a11b-405d-8763-1b4fc2cee106 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:56.649464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 268/541] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:43:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:56.656601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12af6bf-a11b-405d-8763-1b4fc2cee106 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:56.720843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 274/542] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:56.754852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25a71e-4f20-45e9-894c-da7c2e057789 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:56.783013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12af6bf-a11b-405d-8763-1b4fc2cee106 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:56.813754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:56.820302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0c7b-f43f-4c00-8c3d-fbc887985534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:56.820992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0c7b-f43f-4c00-8c3d-fbc887985534 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.821274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0c7b-f43f-4c00-8c3d-fbc887985534 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.821549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0c7b-f43f-4c00-8c3d-fbc887985534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.822481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf0c7b-f43f-4c00-8c3d-fbc887985534 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=688ecef411094633927ffd663ffa1818) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:56.822808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf0c7b-f43f-4c00-8c3d-fbc887985534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:56.824298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf0c7b-f43f-4c00-8c3d-fbc887985534 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:56.831169 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 269/543] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:43:56 2022] GET /identity/v3/role_assignments?user.id=688ecef411094633927ffd663ffa1818&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:56.873957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:56.926263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25a71e-4f20-45e9-894c-da7c2e057789 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:56.963374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5c571-a5a6-48fa-a69e-35f5db71b990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:56.964214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5c571-a5a6-48fa-a69e-35f5db71b990 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:56.964498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5c571-a5a6-48fa-a69e-35f5db71b990 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:56.964776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5c571-a5a6-48fa-a69e-35f5db71b990 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:56.977187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5c571-a5a6-48fa-a69e-35f5db71b990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d7c5c571-a5a6-48fa-a69e-35f5db71b990 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:56.985747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:56.987756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:56.990235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 275/544] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:43:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:57.000069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0c7b-f43f-4c00-8c3d-fbc887985534 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:57.195703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0c7b-f43f-4c00-8c3d-fbc887985534 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:57.256118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680a88b-374f-44cc-a005-44cc2915a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:57.257779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680a88b-374f-44cc-a005-44cc2915a45f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:57.258559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680a88b-374f-44cc-a005-44cc2915a45f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:57.259329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680a88b-374f-44cc-a005-44cc2915a45f None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:57.261038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680a88b-374f-44cc-a005-44cc2915a45f None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:57.261813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680a88b-374f-44cc-a005-44cc2915a45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:57.264677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680a88b-374f-44cc-a005-44cc2915a45f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:57.280715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 270/545] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:43:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:57.287537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5c571-a5a6-48fa-a69e-35f5db71b990 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:57.441125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5c571-a5a6-48fa-a69e-35f5db71b990 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:57.467276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:57.490532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf694e-006d-4a33-9d68-e02c8a53a982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:57.491476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf694e-006d-4a33-9d68-e02c8a53a982 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:57.491759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf694e-006d-4a33-9d68-e02c8a53a982 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:57.492035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf694e-006d-4a33-9d68-e02c8a53a982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:57.509980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf694e-006d-4a33-9d68-e02c8a53a982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:57.511464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf694e-006d-4a33-9d68-e02c8a53a982 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d6bf694e-006d-4a33-9d68-e02c8a53a982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:57.529745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:57.530682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:57.531520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:57.531520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:57.531520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:57.531520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:57.531742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 276/546] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:57.537029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680a88b-374f-44cc-a005-44cc2915a45f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:57.637530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:57.711193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680a88b-374f-44cc-a005-44cc2915a45f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:57.757383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f74ea-7ee3-4b07-aefb-aa151f2717a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:57.758081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f74ea-7ee3-4b07-aefb-aa151f2717a3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:57.758388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f74ea-7ee3-4b07-aefb-aa151f2717a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:57.758665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f74ea-7ee3-4b07-aefb-aa151f2717a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:57.759454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f74ea-7ee3-4b07-aefb-aa151f2717a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:57.759859 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f74ea-7ee3-4b07-aefb-aa151f2717a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:57.761358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f74ea-7ee3-4b07-aefb-aa151f2717a3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:57.774715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 271/547] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:57.784006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf694e-006d-4a33-9d68-e02c8a53a982 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:57.879954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535003-03c4-4041-8477-1ebe0df1a33a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:57.880443 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535003-03c4-4041-8477-1ebe0df1a33a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:57.880825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535003-03c4-4041-8477-1ebe0df1a33a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:57.882527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 272/548] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:57.891154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e266c2-af57-43ac-96ff-d38e86e9f3ff None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:57.891498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e266c2-af57-43ac-96ff-d38e86e9f3ff None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:57.891785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e266c2-af57-43ac-96ff-d38e86e9f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:57.927237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-31e266c2-af57-43ac-96ff-d38e86e9f3ff None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:57.928543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-31e266c2-af57-43ac-96ff-d38e86e9f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:57.951461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf694e-006d-4a33-9d68-e02c8a53a982 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:58.023596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67002d4d-2c8b-4ffa-869d-2f5822504f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:58.024361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67002d4d-2c8b-4ffa-869d-2f5822504f9c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:58.024645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67002d4d-2c8b-4ffa-869d-2f5822504f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:58.024926 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67002d4d-2c8b-4ffa-869d-2f5822504f9c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:58.036037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67002d4d-2c8b-4ffa-869d-2f5822504f9c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:58.037628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67002d4d-2c8b-4ffa-869d-2f5822504f9c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-67002d4d-2c8b-4ffa-869d-2f5822504f9c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:43:58.053970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:58.055581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:43:58.056578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 277/549] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:43:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:58.061111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67002d4d-2c8b-4ffa-869d-2f5822504f9c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:58.078331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 273/550] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:58.106526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:58.120982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e266c2-af57-43ac-96ff-d38e86e9f3ff None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:58.190464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67002d4d-2c8b-4ffa-869d-2f5822504f9c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:58.217830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:58.237969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c80c6f-2585-44f5-854a-6e372ed02c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:58.238944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c80c6f-2585-44f5-854a-6e372ed02c02 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:58.239300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c80c6f-2585-44f5-854a-6e372ed02c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:58.239947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c80c6f-2585-44f5-854a-6e372ed02c02 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:58.241041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c80c6f-2585-44f5-854a-6e372ed02c02 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:58.241444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c80c6f-2585-44f5-854a-6e372ed02c02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:58.243288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c80c6f-2585-44f5-854a-6e372ed02c02 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:58.266743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 278/551] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 12:43:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:58.278213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c80c6f-2585-44f5-854a-6e372ed02c02 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:58.324248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e266c2-af57-43ac-96ff-d38e86e9f3ff None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:58.369780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9dbcf-7729-4957-b023-3177f89ac9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:58.370801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9dbcf-7729-4957-b023-3177f89ac9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:58.371086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9dbcf-7729-4957-b023-3177f89ac9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:58.371364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9dbcf-7729-4957-b023-3177f89ac9c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:58.398436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9dbcf-7729-4957-b023-3177f89ac9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-22f9dbcf-7729-4957-b023-3177f89ac9c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:58.408366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:58.409526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:58.410366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:58.413808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 274/552] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:43:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:43:58.422030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9dbcf-7729-4957-b023-3177f89ac9c1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:58.482526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:58.498729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c80c6f-2585-44f5-854a-6e372ed02c02 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:58.575058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d1a67-4f5f-44c0-986b-26e641567e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:58.575642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d1a67-4f5f-44c0-986b-26e641567e35 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:58.575922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d1a67-4f5f-44c0-986b-26e641567e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:58.576192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d1a67-4f5f-44c0-986b-26e641567e35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:58.628462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9dbcf-7729-4957-b023-3177f89ac9c1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:58.647254 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:58.705346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e52eb-2a57-4781-b213-d9556b2c6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:58.706650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e52eb-2a57-4781-b213-d9556b2c6ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:58.707133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e52eb-2a57-4781-b213-d9556b2c6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:58.707604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e52eb-2a57-4781-b213-d9556b2c6ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:58.708636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e52eb-2a57-4781-b213-d9556b2c6ba6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:58.709238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e52eb-2a57-4781-b213-d9556b2c6ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:58.711148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e52eb-2a57-4781-b213-d9556b2c6ba6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:58.721031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 275/553] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:43:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:58.721222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d1a67-4f5f-44c0-986b-26e641567e35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:58.722805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d1a67-4f5f-44c0-986b-26e641567e35 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:58.723279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c756f09-ef54-4e69-9dec-1359906221b7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:58.723759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c756f09-ef54-4e69-9dec-1359906221b7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:58.724269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c756f09-ef54-4e69-9dec-1359906221b7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:58.726550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 276/554] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:58.731647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c756f09-ef54-4e69-9dec-1359906221b7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:58.863562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c756f09-ef54-4e69-9dec-1359906221b7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:58.875686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:58.885274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 279/555] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:43:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 12:43:58.886689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618257a0-7fea-4003-b704-562c15cded35 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:58.886976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618257a0-7fea-4003-b704-562c15cded35 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:58.887251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618257a0-7fea-4003-b704-562c15cded35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:58.906665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356637b9-55d1-41a0-b55e-f5b7c79aa203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:58.907876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356637b9-55d1-41a0-b55e-f5b7c79aa203 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:58.908352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-618257a0-7fea-4003-b704-562c15cded35 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:58.908541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356637b9-55d1-41a0-b55e-f5b7c79aa203 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:58.909020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356637b9-55d1-41a0-b55e-f5b7c79aa203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:58.909564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-618257a0-7fea-4003-b704-562c15cded35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:58.921422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356637b9-55d1-41a0-b55e-f5b7c79aa203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:58.923618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356637b9-55d1-41a0-b55e-f5b7c79aa203 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-356637b9-55d1-41a0-b55e-f5b7c79aa203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:58.943390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:58.944320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:58.945189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:58.945189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:58.945189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:58.945189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:58.947665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 277/556] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:58.948768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356637b9-55d1-41a0-b55e-f5b7c79aa203 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:58.972624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:58.991355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 280/557] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:58.994152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618257a0-7fea-4003-b704-562c15cded35 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.092183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356637b9-55d1-41a0-b55e-f5b7c79aa203 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:59.115603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618257a0-7fea-4003-b704-562c15cded35 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:59.135659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337316a-666c-40fe-9597-3dd30b9406e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:59.136497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337316a-666c-40fe-9597-3dd30b9406e2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.136782 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337316a-666c-40fe-9597-3dd30b9406e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.137056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337316a-666c-40fe-9597-3dd30b9406e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.144279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:59.151619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337316a-666c-40fe-9597-3dd30b9406e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:59.153575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337316a-666c-40fe-9597-3dd30b9406e2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:59.158352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba93e44-c0ef-4a7c-adf9-4cbd20d4d4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:59.159351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba93e44-c0ef-4a7c-adf9-4cbd20d4d4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.159830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba93e44-c0ef-4a7c-adf9-4cbd20d4d4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.160340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba93e44-c0ef-4a7c-adf9-4cbd20d4d4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.161354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba93e44-c0ef-4a7c-adf9-4cbd20d4d4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:59.162308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba93e44-c0ef-4a7c-adf9-4cbd20d4d4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:59.164017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba93e44-c0ef-4a7c-adf9-4cbd20d4d4c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9337316a-666c-40fe-9597-3dd30b9406e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:59.174015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:59.175470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:59.176333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:59.176333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:59.176333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:59.176333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:59.176333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 278/558] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:59.176652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337316a-666c-40fe-9597-3dd30b9406e2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.181821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 281/559] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:59.183218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba93e44-c0ef-4a7c-adf9-4cbd20d4d4c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.262892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:59.301144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337316a-666c-40fe-9597-3dd30b9406e2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:59.327163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba93e44-c0ef-4a7c-adf9-4cbd20d4d4c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:59.345460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497d0b0-dbf3-4c7b-a241-21d183cf5581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:59.346811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497d0b0-dbf3-4c7b-a241-21d183cf5581 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.347099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497d0b0-dbf3-4c7b-a241-21d183cf5581 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.347374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497d0b0-dbf3-4c7b-a241-21d183cf5581 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.362057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497d0b0-dbf3-4c7b-a241-21d183cf5581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:43:59.371451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b819b72-82cb-4aab-8257-e70e53c31649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:59.372032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b819b72-82cb-4aab-8257-e70e53c31649 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.372315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b819b72-82cb-4aab-8257-e70e53c31649 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.372585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b819b72-82cb-4aab-8257-e70e53c31649 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f497d0b0-dbf3-4c7b-a241-21d183cf5581 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:43:59.373238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:59.374784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:43:59.377017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:59.377747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b819b72-82cb-4aab-8257-e70e53c31649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:59.377747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b819b72-82cb-4aab-8257-e70e53c31649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:59.377891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 279/560] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:43:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:59.377891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497d0b0-dbf3-4c7b-a241-21d183cf5581 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.380242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b819b72-82cb-4aab-8257-e70e53c31649 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:59.398137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 282/561] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:59.398341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0ad2a-2d35-4f20-9c6d-0dee9671217c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.398718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0ad2a-2d35-4f20-9c6d-0dee9671217c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.398947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0ad2a-2d35-4f20-9c6d-0dee9671217c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.400554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 283/562] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:59.401300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0ad2a-2d35-4f20-9c6d-0dee9671217c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.454357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:59.493811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497d0b0-dbf3-4c7b-a241-21d183cf5581 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:59.522449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0ad2a-2d35-4f20-9c6d-0dee9671217c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:59.533142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:59.540544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c851-2b68-40cd-895a-ffc005e78e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:59.541562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c851-2b68-40cd-895a-ffc005e78e00 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.541855 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c851-2b68-40cd-895a-ffc005e78e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.542270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c851-2b68-40cd-895a-ffc005e78e00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.553243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68c851-2b68-40cd-895a-ffc005e78e00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:59.555443 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68c851-2b68-40cd-895a-ffc005e78e00 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:59.561294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd070ddb-d2ad-415d-b616-992f775df2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:59.561994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd070ddb-d2ad-415d-b616-992f775df2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.562314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd070ddb-d2ad-415d-b616-992f775df2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.562593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd070ddb-d2ad-415d-b616-992f775df2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.563343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd070ddb-d2ad-415d-b616-992f775df2e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:59.563642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd070ddb-d2ad-415d-b616-992f775df2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:59.565082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd070ddb-d2ad-415d-b616-992f775df2e3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7d68c851-2b68-40cd-895a-ffc005e78e00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:43:59.571968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:59.572993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:43:59.573994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:59.579600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 280/563] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 12:43:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:59.579686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 284/564] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:43:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:59.579761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c851-2b68-40cd-895a-ffc005e78e00 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.579835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e9ada-1e23-4170-aaa1-8ef9ef1228ac None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.579835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e9ada-1e23-4170-aaa1-8ef9ef1228ac None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.579835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e9ada-1e23-4170-aaa1-8ef9ef1228ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.596657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-038e9ada-1e23-4170-aaa1-8ef9ef1228ac None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:59.597872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-038e9ada-1e23-4170-aaa1-8ef9ef1228ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:59.666864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 285/565] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:59.668169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24c87-fdea-4f58-b9f9-0f7963e32605 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.668446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24c87-fdea-4f58-b9f9-0f7963e32605 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.668722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24c87-fdea-4f58-b9f9-0f7963e32605 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.669967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 286/566] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:43:59.670733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b24c87-fdea-4f58-b9f9-0f7963e32605 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.688671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c851-2b68-40cd-895a-ffc005e78e00 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:59.717863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:59.732090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030c611-12aa-4b61-87d5-1be4616f4e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:59.732913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030c611-12aa-4b61-87d5-1be4616f4e17 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.733191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030c611-12aa-4b61-87d5-1be4616f4e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.733462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030c611-12aa-4b61-87d5-1be4616f4e17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.741476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030c611-12aa-4b61-87d5-1be4616f4e17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:59.742984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030c611-12aa-4b61-87d5-1be4616f4e17 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7030c611-12aa-4b61-87d5-1be4616f4e17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:43:59.759405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:59.760655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:59.761571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:43:59.761571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:43:59.761571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:43:59.761571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:43:59.761571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:43:59.761571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:43:59.761571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:43:59.761571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:59.761571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 281/567] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:59.762138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030c611-12aa-4b61-87d5-1be4616f4e17 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.796693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b24c87-fdea-4f58-b9f9-0f7963e32605 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:59.820899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:43:59.831766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabe4c9-2f1a-4f79-8d91-ab1fff1a7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:59.832457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe4c9-2f1a-4f79-8d91-ab1fff1a7d69 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.832736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe4c9-2f1a-4f79-8d91-ab1fff1a7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.833012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe4c9-2f1a-4f79-8d91-ab1fff1a7d69 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.834008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabe4c9-2f1a-4f79-8d91-ab1fff1a7d69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:43:59.834598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabe4c9-2f1a-4f79-8d91-ab1fff1a7d69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:59.835853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabe4c9-2f1a-4f79-8d91-ab1fff1a7d69 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:59.854194 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 287/568] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 12:43:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:43:59.855637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7ec45-4e6a-4583-ab36-a11d27684eff None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.855907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7ec45-4e6a-4583-ab36-a11d27684eff None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.856175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7ec45-4e6a-4583-ab36-a11d27684eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.874253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f3c7ec45-4e6a-4583-ab36-a11d27684eff None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:43:59.875447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f3c7ec45-4e6a-4583-ab36-a11d27684eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:43:59.878660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030c611-12aa-4b61-87d5-1be4616f4e17 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:43:59.915441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451802b-39e6-42ee-be59-9dbe415ebca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:43:59.916267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451802b-39e6-42ee-be59-9dbe415ebca2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:43:59.916551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451802b-39e6-42ee-be59-9dbe415ebca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:43:59.916830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451802b-39e6-42ee-be59-9dbe415ebca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:43:59.928765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451802b-39e6-42ee-be59-9dbe415ebca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:43:59.930595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451802b-39e6-42ee-be59-9dbe415ebca2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:43:59.947844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 288/569] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:43:59.948700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7ec45-4e6a-4583-ab36-a11d27684eff None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8451802b-39e6-42ee-be59-9dbe415ebca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:43:59.949093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:43:59.950039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:43:59.951092 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:43:59.951092 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:43:59.951092 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:43:59.951092 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:43:59.951092 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 282/570] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:43:59.951366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451802b-39e6-42ee-be59-9dbe415ebca2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:43:59.983405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:00.066434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451802b-39e6-42ee-be59-9dbe415ebca2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.069466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:00.074598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7ec45-4e6a-4583-ab36-a11d27684eff None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.106703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f3878-ce0a-4b25-8743-09fc159f71b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.107402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f3878-ce0a-4b25-8743-09fc159f71b9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.107693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f3878-ce0a-4b25-8743-09fc159f71b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.107980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f3878-ce0a-4b25-8743-09fc159f71b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.108807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f3878-ce0a-4b25-8743-09fc159f71b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:00.109122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f3878-ce0a-4b25-8743-09fc159f71b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:00.110668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f3878-ce0a-4b25-8743-09fc159f71b9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:00.113704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e1d34-32bb-4b87-a469-049c56cdd062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.114668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e1d34-32bb-4b87-a469-049c56cdd062 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.115065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e1d34-32bb-4b87-a469-049c56cdd062 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.115339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e1d34-32bb-4b87-a469-049c56cdd062 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.125347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 283/571] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:00.126266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f3878-ce0a-4b25-8743-09fc159f71b9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.127793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e1d34-32bb-4b87-a469-049c56cdd062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-971e1d34-32bb-4b87-a469-049c56cdd062 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:00.136324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:00.137413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:00.138288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 289/572] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:43:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:00.138988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e1d34-32bb-4b87-a469-049c56cdd062 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.227771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:00.236479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f3878-ce0a-4b25-8743-09fc159f71b9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.246018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e1d34-32bb-4b87-a469-049c56cdd062 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.273870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aa02f-4de0-45f6-95e7-c513b99d2e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.274730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aa02f-4de0-45f6-95e7-c513b99d2e04 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.275013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aa02f-4de0-45f6-95e7-c513b99d2e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.275291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aa02f-4de0-45f6-95e7-c513b99d2e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.281436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95ffde-2d9a-4f55-a183-dff3b3da717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.282134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95ffde-2d9a-4f55-a183-dff3b3da717d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.282421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95ffde-2d9a-4f55-a183-dff3b3da717d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.282702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95ffde-2d9a-4f55-a183-dff3b3da717d None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.283489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95ffde-2d9a-4f55-a183-dff3b3da717d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:00.283800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95ffde-2d9a-4f55-a183-dff3b3da717d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:00.285207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95ffde-2d9a-4f55-a183-dff3b3da717d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:00.286114 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aa02f-4de0-45f6-95e7-c513b99d2e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:00.287869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aa02f-4de0-45f6-95e7-c513b99d2e04 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:00.298818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 290/573] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:00.299700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95ffde-2d9a-4f55-a183-dff3b3da717d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f49aa02f-4de0-45f6-95e7-c513b99d2e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:00.307000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:00.307941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:00.308833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:00.308833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:00.308833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:00.308833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:00.313058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 284/574] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:00.314005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aa02f-4de0-45f6-95e7-c513b99d2e04 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.333822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:00.416428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95ffde-2d9a-4f55-a183-dff3b3da717d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.424875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aa02f-4de0-45f6-95e7-c513b99d2e04 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.452855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511707-5b3a-4c09-a32f-c93ac939dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.453687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511707-5b3a-4c09-a32f-c93ac939dd6f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.453970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511707-5b3a-4c09-a32f-c93ac939dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.454277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511707-5b3a-4c09-a32f-c93ac939dd6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.460987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c736-2fe8-4a64-80f3-e65267af86f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.461647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c736-2fe8-4a64-80f3-e65267af86f6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.461927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c736-2fe8-4a64-80f3-e65267af86f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.462242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c736-2fe8-4a64-80f3-e65267af86f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.463103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744c736-2fe8-4a64-80f3-e65267af86f6 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=ed5fff4bed294d16a0e1d5fec4991c58) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:00.463391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744c736-2fe8-4a64-80f3-e65267af86f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:00.464888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744c736-2fe8-4a64-80f3-e65267af86f6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:00.465182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad511707-5b3a-4c09-a32f-c93ac939dd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:00.470539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 285/575] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/role_assignments?user.id=ed5fff4bed294d16a0e1d5fec4991c58&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:00.471351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c736-2fe8-4a64-80f3-e65267af86f6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ad511707-5b3a-4c09-a32f-c93ac939dd6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:00.474273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:00.475351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:00.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 291/576] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:00.476938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511707-5b3a-4c09-a32f-c93ac939dd6f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.490924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:00.579992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:00.609742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c736-2fe8-4a64-80f3-e65267af86f6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.618190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511707-5b3a-4c09-a32f-c93ac939dd6f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.654825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee8965-12a3-4b5b-bd93-7f3895531730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.655533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8965-12a3-4b5b-bd93-7f3895531730 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.655825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8965-12a3-4b5b-bd93-7f3895531730 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.656141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8965-12a3-4b5b-bd93-7f3895531730 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.656921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee8965-12a3-4b5b-bd93-7f3895531730 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:00.657231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee8965-12a3-4b5b-bd93-7f3895531730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:00.658702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee8965-12a3-4b5b-bd93-7f3895531730 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:00.662922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b0ce6-0a6b-4966-9061-ede0b78dd29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.663774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b0ce6-0a6b-4966-9061-ede0b78dd29d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.664085 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b0ce6-0a6b-4966-9061-ede0b78dd29d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.664353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b0ce6-0a6b-4966-9061-ede0b78dd29d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.675411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 286/577] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:00.675411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee8965-12a3-4b5b-bd93-7f3895531730 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.675704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b0ce6-0a6b-4966-9061-ede0b78dd29d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:00.675783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b0ce6-0a6b-4966-9061-ede0b78dd29d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b06b0ce6-0a6b-4966-9061-ede0b78dd29d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:00.694158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:00.695190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:00.696141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 292/578] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:00.696728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b0ce6-0a6b-4966-9061-ede0b78dd29d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.774460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:00.801593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee8965-12a3-4b5b-bd93-7f3895531730 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.826771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b0ce6-0a6b-4966-9061-ede0b78dd29d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:00.840882 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef122d91-be76-4aac-aea0-1495aa839ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.841665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef122d91-be76-4aac-aea0-1495aa839ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.841952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef122d91-be76-4aac-aea0-1495aa839ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.842404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef122d91-be76-4aac-aea0-1495aa839ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.843121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef122d91-be76-4aac-aea0-1495aa839ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:00.843436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef122d91-be76-4aac-aea0-1495aa839ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:00.844951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef122d91-be76-4aac-aea0-1495aa839ae5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:00.860665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 287/579] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:00.861410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef122d91-be76-4aac-aea0-1495aa839ae5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.868527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:00.869471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dca38-18be-4f19-94bd-62181d80d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:00.870222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dca38-18be-4f19-94bd-62181d80d335 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:00.870743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dca38-18be-4f19-94bd-62181d80d335 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:00.871052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dca38-18be-4f19-94bd-62181d80d335 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:00.871930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dca38-18be-4f19-94bd-62181d80d335 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:00.872249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dca38-18be-4f19-94bd-62181d80d335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:00.873697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dca38-18be-4f19-94bd-62181d80d335 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:00.884890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 293/580] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:00.890335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dca38-18be-4f19-94bd-62181d80d335 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:00.982471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef122d91-be76-4aac-aea0-1495aa839ae5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.011943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dca38-18be-4f19-94bd-62181d80d335 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.023334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fa0a6-8f81-419e-b48c-c01998a16051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.024161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fa0a6-8f81-419e-b48c-c01998a16051 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.024444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fa0a6-8f81-419e-b48c-c01998a16051 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.024772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fa0a6-8f81-419e-b48c-c01998a16051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.035346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fa0a6-8f81-419e-b48c-c01998a16051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.036931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fa0a6-8f81-419e-b48c-c01998a16051 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.043877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:01.054433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b9020-15eb-42bd-94be-5a973333d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.055215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b9020-15eb-42bd-94be-5a973333d89e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.055414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b9020-15eb-42bd-94be-5a973333d89e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.055691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b9020-15eb-42bd-94be-5a973333d89e None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.056653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b9020-15eb-42bd-94be-5a973333d89e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:01.056856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b9020-15eb-42bd-94be-5a973333d89e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f03fa0a6-8f81-419e-b48c-c01998a16051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:01.057166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:01.058127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:01.059032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:01.059032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:01.059032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:01.059032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:01.059251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b9020-15eb-42bd-94be-5a973333d89e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.063313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 288/581] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:01.064027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fa0a6-8f81-419e-b48c-c01998a16051 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.080360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 294/582] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 12:44:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:01.081107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b9020-15eb-42bd-94be-5a973333d89e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.131157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:01.182124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fa0a6-8f81-419e-b48c-c01998a16051 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.194759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b9020-15eb-42bd-94be-5a973333d89e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.218845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4606-bd1d-4d9d-bd34-803256821496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.219829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4606-bd1d-4d9d-bd34-803256821496 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.220434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4606-bd1d-4d9d-bd34-803256821496 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.220726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4606-bd1d-4d9d-bd34-803256821496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.228467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa4606-bd1d-4d9d-bd34-803256821496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.229944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa4606-bd1d-4d9d-bd34-803256821496 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.231339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623638b-530d-47b9-a5de-14c709a748bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.232293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623638b-530d-47b9-a5de-14c709a748bc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.232687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623638b-530d-47b9-a5de-14c709a748bc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.232959 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623638b-530d-47b9-a5de-14c709a748bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.244269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623638b-530d-47b9-a5de-14c709a748bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.245783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623638b-530d-47b9-a5de-14c709a748bc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dafa4606-bd1d-4d9d-bd34-803256821496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:01.245888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:01.246969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:01.247840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:01.247840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:01.247840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:01.247840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:01.247840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:01.247840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:01.247840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:01.247840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:01.250428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 289/583] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:01.252420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4606-bd1d-4d9d-bd34-803256821496 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4623638b-530d-47b9-a5de-14c709a748bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:01.273112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:01.274075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:01.275055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:01.275055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:01.275055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:01.275055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:01.275055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 295/584] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:01.275907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623638b-530d-47b9-a5de-14c709a748bc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.314828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:01.388677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623638b-530d-47b9-a5de-14c709a748bc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.395441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4606-bd1d-4d9d-bd34-803256821496 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.413586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:01.430736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80374185-44a6-4ada-919d-6ead1c774f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.431684 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80374185-44a6-4ada-919d-6ead1c774f7a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.432045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80374185-44a6-4ada-919d-6ead1c774f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.432374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80374185-44a6-4ada-919d-6ead1c774f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.438691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60141e4-48bc-4cbd-8574-1d0aac8dfd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.439533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60141e4-48bc-4cbd-8574-1d0aac8dfd88 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.439813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60141e4-48bc-4cbd-8574-1d0aac8dfd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.440090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60141e4-48bc-4cbd-8574-1d0aac8dfd88 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.440847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60141e4-48bc-4cbd-8574-1d0aac8dfd88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:01.441161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60141e4-48bc-4cbd-8574-1d0aac8dfd88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.442637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60141e4-48bc-4cbd-8574-1d0aac8dfd88 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.444938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80374185-44a6-4ada-919d-6ead1c774f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.446501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80374185-44a6-4ada-919d-6ead1c774f7a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.457619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 290/585] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:01.458376 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60141e4-48bc-4cbd-8574-1d0aac8dfd88 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-80374185-44a6-4ada-919d-6ead1c774f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:01.474827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:01.476612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:01.483773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:01.483773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:01.483773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:01.483773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:01.483773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 296/586] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:01.483773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80374185-44a6-4ada-919d-6ead1c774f7a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.582083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:01.586907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60141e4-48bc-4cbd-8574-1d0aac8dfd88 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.601567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80374185-44a6-4ada-919d-6ead1c774f7a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.637846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0fc78-c3ad-49aa-bbe9-bf8e7706770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.639105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0fc78-c3ad-49aa-bbe9-bf8e7706770d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.639479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0fc78-c3ad-49aa-bbe9-bf8e7706770d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.639853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0fc78-c3ad-49aa-bbe9-bf8e7706770d None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.640679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0fc78-c3ad-49aa-bbe9-bf8e7706770d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:01.640990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0fc78-c3ad-49aa-bbe9-bf8e7706770d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.642483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0fc78-c3ad-49aa-bbe9-bf8e7706770d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.650846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61069685-7c19-4dd7-8b62-e85c1640ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.651794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61069685-7c19-4dd7-8b62-e85c1640ae74 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.652125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61069685-7c19-4dd7-8b62-e85c1640ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.652459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61069685-7c19-4dd7-8b62-e85c1640ae74 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.653240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61069685-7c19-4dd7-8b62-e85c1640ae74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:01.653588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61069685-7c19-4dd7-8b62-e85c1640ae74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.655394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61069685-7c19-4dd7-8b62-e85c1640ae74 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.658173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 291/587] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:01.659285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0fc78-c3ad-49aa-bbe9-bf8e7706770d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.676956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 297/588] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:01.676956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61069685-7c19-4dd7-8b62-e85c1640ae74 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.703027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:01.784559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61069685-7c19-4dd7-8b62-e85c1640ae74 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.785504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0fc78-c3ad-49aa-bbe9-bf8e7706770d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:01.823531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fc3c7-26fc-4461-97a2-7109d9689c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.824210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fc3c7-26fc-4461-97a2-7109d9689c80 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.824493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fc3c7-26fc-4461-97a2-7109d9689c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.824769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fc3c7-26fc-4461-97a2-7109d9689c80 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.825488 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fc3c7-26fc-4461-97a2-7109d9689c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:01.825883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fc3c7-26fc-4461-97a2-7109d9689c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.827469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fc3c7-26fc-4461-97a2-7109d9689c80 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.835190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e32eb-b661-4754-9ee3-3fec132746fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:01.836610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e32eb-b661-4754-9ee3-3fec132746fb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:01.837068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e32eb-b661-4754-9ee3-3fec132746fb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:01.837723 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e32eb-b661-4754-9ee3-3fec132746fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:01.841644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 298/589] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:01.842336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fc3c7-26fc-4461-97a2-7109d9689c80 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.850394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e32eb-b661-4754-9ee3-3fec132746fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:01.853199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e32eb-b661-4754-9ee3-3fec132746fb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:01.854537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0a4e32eb-b661-4754-9ee3-3fec132746fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:01.881243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:01.882461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 12:44:01.883659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:01.886154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 292/590] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:01.887158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e32eb-b661-4754-9ee3-3fec132746fb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:01.976752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fc3c7-26fc-4461-97a2-7109d9689c80 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.025324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:02.026758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a6e9f-4536-4e62-aa14-f7d51c76df47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:02.027769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a6e9f-4536-4e62-aa14-f7d51c76df47 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.028268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a6e9f-4536-4e62-aa14-f7d51c76df47 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.028543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a6e9f-4536-4e62-aa14-f7d51c76df47 None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/09a967d14a7243068a016b4677e47234/roles/b90ffd0563104828953ba36cc5447825` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.033751 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e32eb-b661-4754-9ee3-3fec132746fb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.045637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a6e9f-4536-4e62-aa14-f7d51c76df47 None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=09a967d14a7243068a016b4677e47234, role_id=b90ffd0563104828953ba36cc5447825)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:02.047202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a6e9f-4536-4e62-aa14-f7d51c76df47 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:02.063079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 299/591] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:44:01 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/09a967d14a7243068a016b4677e47234/roles/b90ffd0563104828953ba36cc5447825 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:44:02.064189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a6e9f-4536-4e62-aa14-f7d51c76df47 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:02.083182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108de677-3cfd-4c38-9af5-b0bfee990a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:02.084722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108de677-3cfd-4c38-9af5-b0bfee990a01 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.085247 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108de677-3cfd-4c38-9af5-b0bfee990a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.085485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108de677-3cfd-4c38-9af5-b0bfee990a01 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.098191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108de677-3cfd-4c38-9af5-b0bfee990a01 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:02.100943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108de677-3cfd-4c38-9af5-b0bfee990a01 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-108de677-3cfd-4c38-9af5-b0bfee990a01 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:02.125453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:02.126664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 12:44:02.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:02.133553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 293/592] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:02.134972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108de677-3cfd-4c38-9af5-b0bfee990a01 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:02.163064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:02.230032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a6e9f-4536-4e62-aa14-f7d51c76df47 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.281303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f578617-348c-41a4-be8a-480ca525789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:02.282343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f578617-348c-41a4-be8a-480ca525789b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.282631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f578617-348c-41a4-be8a-480ca525789b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.282913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f578617-348c-41a4-be8a-480ca525789b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.292088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f578617-348c-41a4-be8a-480ca525789b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:02.293798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f578617-348c-41a4-be8a-480ca525789b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:02.304353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108de677-3cfd-4c38-9af5-b0bfee990a01 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9f578617-348c-41a4-be8a-480ca525789b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:02.312174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:02.313796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:02.314927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:02.314927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:02.314927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:02.314927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:02.314927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:02.314927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:02.314927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:02.314927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:02.314927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 300/593] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:02.316449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f578617-348c-41a4-be8a-480ca525789b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:02.360954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51faa3-36a0-4b93-885d-e0cd2e776a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:02.366778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51faa3-36a0-4b93-885d-e0cd2e776a66 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.367205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51faa3-36a0-4b93-885d-e0cd2e776a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.368256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51faa3-36a0-4b93-885d-e0cd2e776a66 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.369290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51faa3-36a0-4b93-885d-e0cd2e776a66 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:02.369712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51faa3-36a0-4b93-885d-e0cd2e776a66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:02.371886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51faa3-36a0-4b93-885d-e0cd2e776a66 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:02.400952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 294/594] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 12:44:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:02.402519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51faa3-36a0-4b93-885d-e0cd2e776a66 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:02.458981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f578617-348c-41a4-be8a-480ca525789b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.483931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:02.486543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:02.510934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de343e-b74f-4b13-b7a1-a447299b45c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:02.511842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de343e-b74f-4b13-b7a1-a447299b45c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.514066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de343e-b74f-4b13-b7a1-a447299b45c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.514456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de343e-b74f-4b13-b7a1-a447299b45c3 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.516637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de343e-b74f-4b13-b7a1-a447299b45c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:02.517772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de343e-b74f-4b13-b7a1-a447299b45c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:02.519497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de343e-b74f-4b13-b7a1-a447299b45c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:02.540596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 301/595] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Jun 17 12:44:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:02.541503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51faa3-36a0-4b93-885d-e0cd2e776a66 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.541671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de343e-b74f-4b13-b7a1-a447299b45c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:02.580046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd3e91-838d-4705-844e-3defe7338756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:02.581064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd3e91-838d-4705-844e-3defe7338756 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.581510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd3e91-838d-4705-844e-3defe7338756 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.581932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd3e91-838d-4705-844e-3defe7338756 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.582949 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd3e91-838d-4705-844e-3defe7338756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:02.583511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd3e91-838d-4705-844e-3defe7338756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:02.585364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd3e91-838d-4705-844e-3defe7338756 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:02.602036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 295/596] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:02.603356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd3e91-838d-4705-844e-3defe7338756 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:02.672335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de343e-b74f-4b13-b7a1-a447299b45c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.692627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:02.715659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125dc06-bf21-4a6c-ace2-8f4d0d5eaf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:02.716644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125dc06-bf21-4a6c-ace2-8f4d0d5eaf0a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.716930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125dc06-bf21-4a6c-ace2-8f4d0d5eaf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.717270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125dc06-bf21-4a6c-ace2-8f4d0d5eaf0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.729899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125dc06-bf21-4a6c-ace2-8f4d0d5eaf0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:02.730974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd3e91-838d-4705-844e-3defe7338756 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.731446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125dc06-bf21-4a6c-ace2-8f4d0d5eaf0a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1125dc06-bf21-4a6c-ace2-8f4d0d5eaf0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:02.754485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:02.757094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:02.758892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:02.758892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:02.758892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:02.758892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:02.758892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 302/597] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:02.759647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125dc06-bf21-4a6c-ace2-8f4d0d5eaf0a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:02.777728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbc814-3bcb-4cb6-801d-e4809401dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:02.778891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbc814-3bcb-4cb6-801d-e4809401dc7f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.779179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbc814-3bcb-4cb6-801d-e4809401dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.779461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbc814-3bcb-4cb6-801d-e4809401dc7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.791301 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:02.794454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbc814-3bcb-4cb6-801d-e4809401dc7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:02.796153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbc814-3bcb-4cb6-801d-e4809401dc7f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8bdbc814-3bcb-4cb6-801d-e4809401dc7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:02.816307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:02.817587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:02.818972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:02.818972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:02.818972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:02.818972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:02.818972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 296/598] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:02.819828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b4a1b-5b82-40d6-a8c9-06bd9773d47c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.820124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b4a1b-5b82-40d6-a8c9-06bd9773d47c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.820405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b4a1b-5b82-40d6-a8c9-06bd9773d47c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.821946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 297/599] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:02.822540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b4a1b-5b82-40d6-a8c9-06bd9773d47c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:02.903799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125dc06-bf21-4a6c-ace2-8f4d0d5eaf0a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.947297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b4a1b-5b82-40d6-a8c9-06bd9773d47c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:02.954495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a19e8-821e-4186-8cd1-2a4c91099dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:02.956081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a19e8-821e-4186-8cd1-2a4c91099dae None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:02.956081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a19e8-821e-4186-8cd1-2a4c91099dae None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:02.956081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a19e8-821e-4186-8cd1-2a4c91099dae None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/984780a6a8df405dbbb2ba4c46dd841c/roles/b90ffd0563104828953ba36cc5447825` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:02.974109 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a19e8-821e-4186-8cd1-2a4c91099dae None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=984780a6a8df405dbbb2ba4c46dd841c, role_id=b90ffd0563104828953ba36cc5447825)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:02.976843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a19e8-821e-4186-8cd1-2a4c91099dae None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:02.983543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:02.997066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 303/600] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:44:02 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/984780a6a8df405dbbb2ba4c46dd841c/roles/b90ffd0563104828953ba36cc5447825 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:44:02.997832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a19e8-821e-4186-8cd1-2a4c91099dae None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:03.007103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5956b2-bda9-4bc9-9bf1-a3d2ec05e3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.008949 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5956b2-bda9-4bc9-9bf1-a3d2ec05e3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.009590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5956b2-bda9-4bc9-9bf1-a3d2ec05e3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.010124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5956b2-bda9-4bc9-9bf1-a3d2ec05e3b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.011609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5956b2-bda9-4bc9-9bf1-a3d2ec05e3b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:03.012192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5956b2-bda9-4bc9-9bf1-a3d2ec05e3b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:03.014766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5956b2-bda9-4bc9-9bf1-a3d2ec05e3b9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:03.039303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 298/601] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:03.041171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69caf75-9e93-4d56-9800-a03cb9f9ef10 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.041682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69caf75-9e93-4d56-9800-a03cb9f9ef10 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.042207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69caf75-9e93-4d56-9800-a03cb9f9ef10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.068107 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f69caf75-9e93-4d56-9800-a03cb9f9ef10 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:03.070808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f69caf75-9e93-4d56-9800-a03cb9f9ef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:03.110948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:03.143145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a19e8-821e-4186-8cd1-2a4c91099dae None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:03.174445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 299/602] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:03.175320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69caf75-9e93-4d56-9800-a03cb9f9ef10 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:03.184568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c743215-6092-47f4-aa87-e1e0e5641068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.185307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c743215-6092-47f4-aa87-e1e0e5641068 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.186011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c743215-6092-47f4-aa87-e1e0e5641068 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.186011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c743215-6092-47f4-aa87-e1e0e5641068 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.186899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c743215-6092-47f4-aa87-e1e0e5641068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:03.187293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c743215-6092-47f4-aa87-e1e0e5641068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:03.188751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c743215-6092-47f4-aa87-e1e0e5641068 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:03.205330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 304/603] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:03.206172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c743215-6092-47f4-aa87-e1e0e5641068 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:03.318309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69caf75-9e93-4d56-9800-a03cb9f9ef10 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:03.341993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:03.344969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c743215-6092-47f4-aa87-e1e0e5641068 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:03.370826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d2557-22ba-44f4-bbbd-b62d5beddc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.371984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d2557-22ba-44f4-bbbd-b62d5beddc47 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.373140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d2557-22ba-44f4-bbbd-b62d5beddc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.373633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d2557-22ba-44f4-bbbd-b62d5beddc47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.384370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d2557-22ba-44f4-bbbd-b62d5beddc47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:03.386425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d2557-22ba-44f4-bbbd-b62d5beddc47 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:03.398287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337e151-4bac-4165-ac17-6c7646a6f735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.399570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e151-4bac-4165-ac17-6c7646a6f735 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.399983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e151-4bac-4165-ac17-6c7646a6f735 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.400750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e151-4bac-4165-ac17-6c7646a6f735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-610d2557-22ba-44f4-bbbd-b62d5beddc47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:03.403252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:03.404294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:03.405311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:03.405311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:03.405311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:03.405311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:03.405311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:03.405311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:03.405311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:03.405311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:03.411635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 300/604] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:03.413102 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d2557-22ba-44f4-bbbd-b62d5beddc47 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:03.414476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:03.424628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337e151-4bac-4165-ac17-6c7646a6f735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0337e151-4bac-4165-ac17-6c7646a6f735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:03.434038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:03.435180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:03.436008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:03.438561 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 305/605] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:03.439674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337e151-4bac-4165-ac17-6c7646a6f735 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:03.546959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d2557-22ba-44f4-bbbd-b62d5beddc47 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:03.558053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337e151-4bac-4165-ac17-6c7646a6f735 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:03.584630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151a5ed-37cc-4ddb-94eb-6fdec0294c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.585463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151a5ed-37cc-4ddb-94eb-6fdec0294c79 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.585747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151a5ed-37cc-4ddb-94eb-6fdec0294c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.586026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151a5ed-37cc-4ddb-94eb-6fdec0294c79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.593912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151a5ed-37cc-4ddb-94eb-6fdec0294c79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:03.595522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151a5ed-37cc-4ddb-94eb-6fdec0294c79 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:03.598831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a8c4a-f7d6-4368-b7fa-a994b3c6fd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.599895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a8c4a-f7d6-4368-b7fa-a994b3c6fd78 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.600324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a8c4a-f7d6-4368-b7fa-a994b3c6fd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.600734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a8c4a-f7d6-4368-b7fa-a994b3c6fd78 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.601672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a8c4a-f7d6-4368-b7fa-a994b3c6fd78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:03.602138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a8c4a-f7d6-4368-b7fa-a994b3c6fd78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:03.603795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a8c4a-f7d6-4368-b7fa-a994b3c6fd78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8151a5ed-37cc-4ddb-94eb-6fdec0294c79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:03.611573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:03.613173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:03.614347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:03.614347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:03.614347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:03.614347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:03.614347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:03.614347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:03.614347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:03.614347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:03.617911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 301/606] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:03.618928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151a5ed-37cc-4ddb-94eb-6fdec0294c79 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:03.621809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 306/607] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:03.622984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a8c4a-f7d6-4368-b7fa-a994b3c6fd78 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:03.662331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:03.691395 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:03.740337 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151a5ed-37cc-4ddb-94eb-6fdec0294c79 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:03.744356 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a8c4a-f7d6-4368-b7fa-a994b3c6fd78 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:03.787095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2d4b0-f683-444f-b671-b042ff42f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.788106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2d4b0-f683-444f-b671-b042ff42f641 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.788847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2d4b0-f683-444f-b671-b042ff42f641 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.789367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2d4b0-f683-444f-b671-b042ff42f641 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.790643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2d4b0-f683-444f-b671-b042ff42f641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:03.791389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2d4b0-f683-444f-b671-b042ff42f641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:03.793463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2d4b0-f683-444f-b671-b042ff42f641 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:03.797203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33409093-710a-4af8-a57d-678a21d5f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.798139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33409093-710a-4af8-a57d-678a21d5f1fe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.798304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33409093-710a-4af8-a57d-678a21d5f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.798614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33409093-710a-4af8-a57d-678a21d5f1fe None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.799475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33409093-710a-4af8-a57d-678a21d5f1fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:03.799791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33409093-710a-4af8-a57d-678a21d5f1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:03.801261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33409093-710a-4af8-a57d-678a21d5f1fe None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:03.811068 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 307/608] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:03.811997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2d4b0-f683-444f-b671-b042ff42f641 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:03.815998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 302/609] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:03.822857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33409093-710a-4af8-a57d-678a21d5f1fe None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:03.945470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:03.948208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2d4b0-f683-444f-b671-b042ff42f641 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:03.952671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33409093-710a-4af8-a57d-678a21d5f1fe None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:03.969650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:03.990265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b917d-e51e-40f2-b3da-cfd4efab79c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.990836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400b9be-7b53-48e4-b8ba-24cd4bc92eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:03.991635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b917d-e51e-40f2-b3da-cfd4efab79c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.991763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b9be-7b53-48e4-b8ba-24cd4bc92eec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:03.991935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b9be-7b53-48e4-b8ba-24cd4bc92eec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.992211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b9be-7b53-48e4-b8ba-24cd4bc92eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:03.992449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b917d-e51e-40f2-b3da-cfd4efab79c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:03.993020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b917d-e51e-40f2-b3da-cfd4efab79c2 None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/68fc7c689f3645149d927663730bab5e/roles/b90ffd0563104828953ba36cc5447825` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:04.003947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400b9be-7b53-48e4-b8ba-24cd4bc92eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:04.005471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400b9be-7b53-48e4-b8ba-24cd4bc92eec None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:04.010548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b917d-e51e-40f2-b3da-cfd4efab79c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=68fc7c689f3645149d927663730bab5e, role_id=b90ffd0563104828953ba36cc5447825)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:04.012345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b917d-e51e-40f2-b3da-cfd4efab79c2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4400b9be-7b53-48e4-b8ba-24cd4bc92eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:04.024528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:04.025680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:04.027061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:04.027061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:04.027061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:04.027061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:04.030532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 303/610] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:04.031525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400b9be-7b53-48e4-b8ba-24cd4bc92eec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:04.041278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 308/611] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:44:03 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/68fc7c689f3645149d927663730bab5e/roles/b90ffd0563104828953ba36cc5447825 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:44:04.042561 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b917d-e51e-40f2-b3da-cfd4efab79c2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:04.143370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400b9be-7b53-48e4-b8ba-24cd4bc92eec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:04.191906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442d16-3c48-40b9-be59-b8fd5ae637db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:04.193130 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442d16-3c48-40b9-be59-b8fd5ae637db None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:04.193564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442d16-3c48-40b9-be59-b8fd5ae637db None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:04.193871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442d16-3c48-40b9-be59-b8fd5ae637db None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/688ecef411094633927ffd663ffa1818/roles/b90ffd0563104828953ba36cc5447825` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:04.239334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8442d16-3c48-40b9-be59-b8fd5ae637db None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=688ecef411094633927ffd663ffa1818, role_id=b90ffd0563104828953ba36cc5447825)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:04.240938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8442d16-3c48-40b9-be59-b8fd5ae637db None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:04.261000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:04.263226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b917d-e51e-40f2-b3da-cfd4efab79c2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:04.268844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 304/612] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:44:04 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/688ecef411094633927ffd663ffa1818/roles/b90ffd0563104828953ba36cc5447825 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:44:04.319621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c8185-413f-4255-90c0-f1b7e3d796ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:04.320661 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c8185-413f-4255-90c0-f1b7e3d796ee None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:04.320948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c8185-413f-4255-90c0-f1b7e3d796ee None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:04.321304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c8185-413f-4255-90c0-f1b7e3d796ee None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:04.322700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c8185-413f-4255-90c0-f1b7e3d796ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:04.323087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c8185-413f-4255-90c0-f1b7e3d796ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:04.325021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c8185-413f-4255-90c0-f1b7e3d796ee None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:04.356928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 309/613] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:04.364431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442d16-3c48-40b9-be59-b8fd5ae637db None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:04.508202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442d16-3c48-40b9-be59-b8fd5ae637db None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:04.545008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0457-a2fc-49a4-aad3-f1b7656b2490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:04.545838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0457-a2fc-49a4-aad3-f1b7656b2490 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:04.546142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0457-a2fc-49a4-aad3-f1b7656b2490 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:04.546419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0457-a2fc-49a4-aad3-f1b7656b2490 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:04.554794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0457-a2fc-49a4-aad3-f1b7656b2490 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:04.556293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0457-a2fc-49a4-aad3-f1b7656b2490 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b43b0457-a2fc-49a4-aad3-f1b7656b2490 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:04.572790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:04.573771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:04.574988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 305/614] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:04.583938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c8185-413f-4255-90c0-f1b7e3d796ee None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:04.625345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:04.708165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c8185-413f-4255-90c0-f1b7e3d796ee None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:04.712551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd2d52-2de7-4d4b-8cdf-fd362053d051 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:04.712837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd2d52-2de7-4d4b-8cdf-fd362053d051 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:04.713116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd2d52-2de7-4d4b-8cdf-fd362053d051 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:04.714860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 306/615] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:04.720282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603994-9368-4dcd-8bc3-b27c910e893c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:04.720570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603994-9368-4dcd-8bc3-b27c910e893c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:04.720845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603994-9368-4dcd-8bc3-b27c910e893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:04.740268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-54603994-9368-4dcd-8bc3-b27c910e893c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:04.741559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-54603994-9368-4dcd-8bc3-b27c910e893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:04.770247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad61211-7207-490f-8017-75b67d74ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:04.771802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad61211-7207-490f-8017-75b67d74ba84 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:04.776909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad61211-7207-490f-8017-75b67d74ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:04.777521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad61211-7207-490f-8017-75b67d74ba84 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:04.778639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad61211-7207-490f-8017-75b67d74ba84 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:04.779204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad61211-7207-490f-8017-75b67d74ba84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:04.780932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad61211-7207-490f-8017-75b67d74ba84 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:04.827931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 310/616] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 12:44:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:04.834736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad61211-7207-490f-8017-75b67d74ba84 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:04.867558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:04.898466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 307/617] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:44:04.953415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603994-9368-4dcd-8bc3-b27c910e893c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:05.042766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:05.069612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad61211-7207-490f-8017-75b67d74ba84 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:05.195947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603994-9368-4dcd-8bc3-b27c910e893c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:05.198837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6547f4-fd77-4a8f-b0ae-59ac6ccbc988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:05.199690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6547f4-fd77-4a8f-b0ae-59ac6ccbc988 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:05.199977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6547f4-fd77-4a8f-b0ae-59ac6ccbc988 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:05.200319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6547f4-fd77-4a8f-b0ae-59ac6ccbc988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:05.235117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6547f4-fd77-4a8f-b0ae-59ac6ccbc988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:05.236815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6547f4-fd77-4a8f-b0ae-59ac6ccbc988 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:05.238268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c590960-b885-4e0f-93bc-6dbd5ebb7506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:05.239224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c590960-b885-4e0f-93bc-6dbd5ebb7506 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:05.239781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c590960-b885-4e0f-93bc-6dbd5ebb7506 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:05.240212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c590960-b885-4e0f-93bc-6dbd5ebb7506 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:05.253259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c590960-b885-4e0f-93bc-6dbd5ebb7506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3c590960-b885-4e0f-93bc-6dbd5ebb7506 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:05.265480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:05.267272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:05.268860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 308/618] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:05.274036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c590960-b885-4e0f-93bc-6dbd5ebb7506 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-cf6547f4-fd77-4a8f-b0ae-59ac6ccbc988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:05.291055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:05.294698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:05.298135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:05.298135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:05.298135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:05.298135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:05.298135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 311/619] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:05.299116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6547f4-fd77-4a8f-b0ae-59ac6ccbc988 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:05.398488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:05.512906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c590960-b885-4e0f-93bc-6dbd5ebb7506 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:05.539336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6547f4-fd77-4a8f-b0ae-59ac6ccbc988 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:05.590045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993fe16-9643-4563-879a-77502e536e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:05.591273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993fe16-9643-4563-879a-77502e536e89 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:05.591756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993fe16-9643-4563-879a-77502e536e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:05.592246 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993fe16-9643-4563-879a-77502e536e89 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:05.593219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993fe16-9643-4563-879a-77502e536e89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:05.593733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993fe16-9643-4563-879a-77502e536e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:05.595381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993fe16-9643-4563-879a-77502e536e89 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:05.606240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 309/620] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:05.607984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366d2f-2b8c-4f78-9942-51bce03c1128 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:05.608582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366d2f-2b8c-4f78-9942-51bce03c1128 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:05.609101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43366d2f-2b8c-4f78-9942-51bce03c1128 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:05.615770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 310/621] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:05.616990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43366d2f-2b8c-4f78-9942-51bce03c1128 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:05.625281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146330c-c857-441c-9649-2d0cbf6d09c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:05.626469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146330c-c857-441c-9649-2d0cbf6d09c2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:05.626944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146330c-c857-441c-9649-2d0cbf6d09c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:05.627396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146330c-c857-441c-9649-2d0cbf6d09c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:05.628781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146330c-c857-441c-9649-2d0cbf6d09c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:05.629333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146330c-c857-441c-9649-2d0cbf6d09c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:05.633911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146330c-c857-441c-9649-2d0cbf6d09c2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:05.650657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:05.664002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 312/622] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:05.668072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71502-3afe-455a-8dc6-76a81eaf1a37 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:05.668535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71502-3afe-455a-8dc6-76a81eaf1a37 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:05.669020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71502-3afe-455a-8dc6-76a81eaf1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:05.702686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ace71502-3afe-455a-8dc6-76a81eaf1a37 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:05.706200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ace71502-3afe-455a-8dc6-76a81eaf1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:05.751800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43366d2f-2b8c-4f78-9942-51bce03c1128 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:05.767378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:05.805722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e512037-ca1c-4527-bc4b-3b5884291ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:05.807192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512037-ca1c-4527-bc4b-3b5884291ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:05.807683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512037-ca1c-4527-bc4b-3b5884291ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:05.808230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e512037-ca1c-4527-bc4b-3b5884291ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:05.828109 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 313/623] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:05.828992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512037-ca1c-4527-bc4b-3b5884291ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:05.829102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71502-3afe-455a-8dc6-76a81eaf1a37 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:05.832089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e512037-ca1c-4527-bc4b-3b5884291ea7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9e512037-ca1c-4527-bc4b-3b5884291ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:05.870787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:05.871741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:05.872664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:05.872664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:05.872664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:05.872664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:05.878112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 311/624] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:05.878112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e512037-ca1c-4527-bc4b-3b5884291ea7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:05.958241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71502-3afe-455a-8dc6-76a81eaf1a37 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:05.996029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:06.007246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fec49-9598-4f4a-b365-988a13fcdda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:06.008090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fec49-9598-4f4a-b365-988a13fcdda0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:06.008480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fec49-9598-4f4a-b365-988a13fcdda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:06.008642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fec49-9598-4f4a-b365-988a13fcdda0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:06.016657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fec49-9598-4f4a-b365-988a13fcdda0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:06.018244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fec49-9598-4f4a-b365-988a13fcdda0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ec2fec49-9598-4f4a-b365-988a13fcdda0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:06.036352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:06.038408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 314/625] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:06.040470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fec49-9598-4f4a-b365-988a13fcdda0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:06.076815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e512037-ca1c-4527-bc4b-3b5884291ea7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:06.142006 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4c29-d853-49bb-9fb8-ce9bf3567185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:06.143643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4c29-d853-49bb-9fb8-ce9bf3567185 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:06.144258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4c29-d853-49bb-9fb8-ce9bf3567185 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:06.144888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4c29-d853-49bb-9fb8-ce9bf3567185 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:06.162578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fec49-9598-4f4a-b365-988a13fcdda0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:06.164593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a4c29-d853-49bb-9fb8-ce9bf3567185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f60a4c29-d853-49bb-9fb8-ce9bf3567185 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:06.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:06.182581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:06.184265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:06.187853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 312/626] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:06.189689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4c29-d853-49bb-9fb8-ce9bf3567185 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:06.202060 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421994c-6e14-4008-b3bd-13e0e2ba4a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:06.202800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421994c-6e14-4008-b3bd-13e0e2ba4a95 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:06.203086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421994c-6e14-4008-b3bd-13e0e2ba4a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:06.203429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421994c-6e14-4008-b3bd-13e0e2ba4a95 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:06.204167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421994c-6e14-4008-b3bd-13e0e2ba4a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:06.204537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421994c-6e14-4008-b3bd-13e0e2ba4a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:06.206033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421994c-6e14-4008-b3bd-13e0e2ba4a95 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:06.225626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 315/627] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:06.226693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421994c-6e14-4008-b3bd-13e0e2ba4a95 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:06.241947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:06.292937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:06.360676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421994c-6e14-4008-b3bd-13e0e2ba4a95 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:06.396456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4c29-d853-49bb-9fb8-ce9bf3567185 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:06.408401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864abe47-6435-42e6-a30d-c74edef61468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:06.409097 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864abe47-6435-42e6-a30d-c74edef61468 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:06.409385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864abe47-6435-42e6-a30d-c74edef61468 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:06.409664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864abe47-6435-42e6-a30d-c74edef61468 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:06.410460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864abe47-6435-42e6-a30d-c74edef61468 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:06.410769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864abe47-6435-42e6-a30d-c74edef61468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:06.412267 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864abe47-6435-42e6-a30d-c74edef61468 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:06.421916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 316/628] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:06.422885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864abe47-6435-42e6-a30d-c74edef61468 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:06.465248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec009a-d303-4abf-bc6f-0ff892c42d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:06.467058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec009a-d303-4abf-bc6f-0ff892c42d2b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:06.467779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec009a-d303-4abf-bc6f-0ff892c42d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:06.468606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec009a-d303-4abf-bc6f-0ff892c42d2b None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:06.470731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec009a-d303-4abf-bc6f-0ff892c42d2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:06.471581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec009a-d303-4abf-bc6f-0ff892c42d2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:06.475128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec009a-d303-4abf-bc6f-0ff892c42d2b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:06.499565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 313/629] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:06.501370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec009a-d303-4abf-bc6f-0ff892c42d2b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:06.531436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864abe47-6435-42e6-a30d-c74edef61468 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:06.543443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:06.570923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bae9d1-7b9f-45c1-8a55-2df706abf9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:06.571243 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae9d1-7b9f-45c1-8a55-2df706abf9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:06.571375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae9d1-7b9f-45c1-8a55-2df706abf9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:06.571694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae9d1-7b9f-45c1-8a55-2df706abf9f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:06.580896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bae9d1-7b9f-45c1-8a55-2df706abf9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:06.583840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bae9d1-7b9f-45c1-8a55-2df706abf9f2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-19bae9d1-7b9f-45c1-8a55-2df706abf9f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:06.601174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:06.603763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 317/630] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 12:44:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:06.605588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bae9d1-7b9f-45c1-8a55-2df706abf9f2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:06.652112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:06.681979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec009a-d303-4abf-bc6f-0ff892c42d2b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:06.727472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3e06e-e330-47ca-8b18-598e164d65d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:06.727695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bae9d1-7b9f-45c1-8a55-2df706abf9f2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:06.728941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3e06e-e330-47ca-8b18-598e164d65d1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:06.729486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3e06e-e330-47ca-8b18-598e164d65d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:06.729968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3e06e-e330-47ca-8b18-598e164d65d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:06.745630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3e06e-e330-47ca-8b18-598e164d65d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:06.747891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3e06e-e330-47ca-8b18-598e164d65d1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:06.770762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c890207-2ce6-4860-b5ce-35ca4dd7914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:06.771761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c890207-2ce6-4860-b5ce-35ca4dd7914f None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:06.772043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c890207-2ce6-4860-b5ce-35ca4dd7914f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:06.772317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c890207-2ce6-4860-b5ce-35ca4dd7914f None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/ed5fff4bed294d16a0e1d5fec4991c58/roles/b90ffd0563104828953ba36cc5447825` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-60b3e06e-e330-47ca-8b18-598e164d65d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:06.773634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:06.774822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:06.775714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:06.775714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:06.775714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:06.775714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:06.778525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 314/631] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:06.780183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3e06e-e330-47ca-8b18-598e164d65d1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:06.791537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c890207-2ce6-4860-b5ce-35ca4dd7914f None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=ed5fff4bed294d16a0e1d5fec4991c58, role_id=b90ffd0563104828953ba36cc5447825)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:06.793060 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c890207-2ce6-4860-b5ce-35ca4dd7914f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:06.815185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 318/632] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:44:06 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/ed5fff4bed294d16a0e1d5fec4991c58/roles/b90ffd0563104828953ba36cc5447825 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:44:06.823005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c890207-2ce6-4860-b5ce-35ca4dd7914f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:06.856898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:06.961705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c890207-2ce6-4860-b5ce-35ca4dd7914f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:06.966259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3e06e-e330-47ca-8b18-598e164d65d1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:07.017089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b8f7a-3015-4a07-83af-eff0bea25df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:07.018347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8f7a-3015-4a07-83af-eff0bea25df2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.018853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8f7a-3015-4a07-83af-eff0bea25df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.019341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8f7a-3015-4a07-83af-eff0bea25df2 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.020693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b8f7a-3015-4a07-83af-eff0bea25df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:07.021348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd70240-e45b-4bc0-8764-04b4467dbab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:07.021697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b8f7a-3015-4a07-83af-eff0bea25df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:07.022064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd70240-e45b-4bc0-8764-04b4467dbab0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.022401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd70240-e45b-4bc0-8764-04b4467dbab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.022669 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd70240-e45b-4bc0-8764-04b4467dbab0 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.023517 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd70240-e45b-4bc0-8764-04b4467dbab0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:07.023823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd70240-e45b-4bc0-8764-04b4467dbab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:07.024398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b8f7a-3015-4a07-83af-eff0bea25df2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:07.025259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd70240-e45b-4bc0-8764-04b4467dbab0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:07.027196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:07.050464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 315/633] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 12:44:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:07.050659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 319/634] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:07.050740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef0ced-fcd3-4223-9720-0e7cfb7fd303 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.050740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef0ced-fcd3-4223-9720-0e7cfb7fd303 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.050740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef0ced-fcd3-4223-9720-0e7cfb7fd303 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.050950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667df97-3ff7-41cd-aa8e-3c4527e63559 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.050950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667df97-3ff7-41cd-aa8e-3c4527e63559 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.051078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 316/635] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:07.051159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667df97-3ff7-41cd-aa8e-3c4527e63559 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.055160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef0ced-fcd3-4223-9720-0e7cfb7fd303 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:07.056786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 320/636] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:07.057586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667df97-3ff7-41cd-aa8e-3c4527e63559 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:07.162277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:07.186920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667df97-3ff7-41cd-aa8e-3c4527e63559 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:07.201572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef0ced-fcd3-4223-9720-0e7cfb7fd303 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:07.226577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aafe92-91e9-4217-8201-b9946ac0fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:07.227326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aafe92-91e9-4217-8201-b9946ac0fb39 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.227609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aafe92-91e9-4217-8201-b9946ac0fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.227884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aafe92-91e9-4217-8201-b9946ac0fb39 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.236161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aafe92-91e9-4217-8201-b9946ac0fb39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:07.238332 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aafe92-91e9-4217-8201-b9946ac0fb39 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:07.245484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235a7a3-568a-4598-8bea-7d93d89dfdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:07.246184 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235a7a3-568a-4598-8bea-7d93d89dfdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.246473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235a7a3-568a-4598-8bea-7d93d89dfdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.246747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235a7a3-568a-4598-8bea-7d93d89dfdd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c8aafe92-91e9-4217-8201-b9946ac0fb39 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:07.255775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:07.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 12:44:07.257718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:07.259644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 321/637] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:07.261072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16530ce-c9e3-4bb9-9a88-ee2d5cc6c9ac None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.261570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16530ce-c9e3-4bb9-9a88-ee2d5cc6c9ac None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.262045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16530ce-c9e3-4bb9-9a88-ee2d5cc6c9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.281965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d16530ce-c9e3-4bb9-9a88-ee2d5cc6c9ac None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:07.283220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d16530ce-c9e3-4bb9-9a88-ee2d5cc6c9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:07.319238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:07.330335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235a7a3-568a-4598-8bea-7d93d89dfdd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:07.331850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235a7a3-568a-4598-8bea-7d93d89dfdd6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:07.374118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 322/638] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:07.374118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662c7a-9a51-4dbc-baa2-23d7a1605a9c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.374118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662c7a-9a51-4dbc-baa2-23d7a1605a9c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.374118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662c7a-9a51-4dbc-baa2-23d7a1605a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.395260 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ba662c7a-9a51-4dbc-baa2-23d7a1605a9c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:07.396496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ba662c7a-9a51-4dbc-baa2-23d7a1605a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:07.481096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 317/639] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:07.482016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235a7a3-568a-4598-8bea-7d93d89dfdd6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:07.487926 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:07.498453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 323/640] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:07.500015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba662c7a-9a51-4dbc-baa2-23d7a1605a9c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:07.603591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:07.615433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235a7a3-568a-4598-8bea-7d93d89dfdd6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:07.626514 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba662c7a-9a51-4dbc-baa2-23d7a1605a9c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:07.654495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3051be8-b91d-401f-ba30-a78e1523b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:07.655377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3051be8-b91d-401f-ba30-a78e1523b83e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.655489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3051be8-b91d-401f-ba30-a78e1523b83e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.655721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3051be8-b91d-401f-ba30-a78e1523b83e None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.657160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3051be8-b91d-401f-ba30-a78e1523b83e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:07.657160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3051be8-b91d-401f-ba30-a78e1523b83e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:07.658383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3051be8-b91d-401f-ba30-a78e1523b83e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:07.665725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9af5ad-7e63-43f8-86ec-e8d960c56525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:07.666597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9af5ad-7e63-43f8-86ec-e8d960c56525 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.666873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9af5ad-7e63-43f8-86ec-e8d960c56525 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.667245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9af5ad-7e63-43f8-86ec-e8d960c56525 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.678542 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9af5ad-7e63-43f8-86ec-e8d960c56525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:07.679160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 318/641] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 12:44:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:07.679994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3051be8-b91d-401f-ba30-a78e1523b83e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4f9af5ad-7e63-43f8-86ec-e8d960c56525 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:07.691658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:07.693495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 324/642] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:07.695891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9af5ad-7e63-43f8-86ec-e8d960c56525 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:07.778802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:07.820701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3051be8-b91d-401f-ba30-a78e1523b83e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:07.843291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9af5ad-7e63-43f8-86ec-e8d960c56525 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:07.863666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ed856-a617-4af0-9d66-6d4ab90cf691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:07.864806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ed856-a617-4af0-9d66-6d4ab90cf691 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.865864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ed856-a617-4af0-9d66-6d4ab90cf691 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.866355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ed856-a617-4af0-9d66-6d4ab90cf691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.883285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ed856-a617-4af0-9d66-6d4ab90cf691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:07.885676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ed856-a617-4af0-9d66-6d4ab90cf691 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:07.891681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c085b-c995-4d60-b2d9-7fb98e229ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:07.893421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c085b-c995-4d60-b2d9-7fb98e229ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:07.894016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c085b-c995-4d60-b2d9-7fb98e229ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:07.894664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c085b-c995-4d60-b2d9-7fb98e229ad3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:07.907849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c085b-c995-4d60-b2d9-7fb98e229ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-fd6c085b-c995-4d60-b2d9-7fb98e229ad3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:07.917051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:07.918385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:07.919263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:07.919907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 325/643] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:07.920303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c085b-c995-4d60-b2d9-7fb98e229ad3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-033ed856-a617-4af0-9d66-6d4ab90cf691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:07.924514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:07.925503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:07.927141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:07.927141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:07.927141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:07.927141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:07.929695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 319/644] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:07.931309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ed856-a617-4af0-9d66-6d4ab90cf691 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:07.935647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:08.062820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c085b-c995-4d60-b2d9-7fb98e229ad3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:08.088247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:08.100748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ed856-a617-4af0-9d66-6d4ab90cf691 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:08.107404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97323499-d329-42ca-9ecb-846c1aba3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:08.108164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97323499-d329-42ca-9ecb-846c1aba3a03 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:08.108451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97323499-d329-42ca-9ecb-846c1aba3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:08.108735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97323499-d329-42ca-9ecb-846c1aba3a03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:08.153152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d0c1-ce78-4f6e-b54d-10504dcb8635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:08.154482 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d0c1-ce78-4f6e-b54d-10504dcb8635 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:08.154883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d0c1-ce78-4f6e-b54d-10504dcb8635 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:08.155405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d0c1-ce78-4f6e-b54d-10504dcb8635 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:08.156688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d0c1-ce78-4f6e-b54d-10504dcb8635 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:08.157365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d0c1-ce78-4f6e-b54d-10504dcb8635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:08.159450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d0c1-ce78-4f6e-b54d-10504dcb8635 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:08.176833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 320/645] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:08.176833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d0c1-ce78-4f6e-b54d-10504dcb8635 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:08.205539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97323499-d329-42ca-9ecb-846c1aba3a03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:08.207352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97323499-d329-42ca-9ecb-846c1aba3a03 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:08.248270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:08.317030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d0c1-ce78-4f6e-b54d-10504dcb8635 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:08.350144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 326/646] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:08.350588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97323499-d329-42ca-9ecb-846c1aba3a03 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:08.367526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c2588-466b-4517-b63c-350118995f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:08.368245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2588-466b-4517-b63c-350118995f57 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:08.368522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2588-466b-4517-b63c-350118995f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:08.368776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2588-466b-4517-b63c-350118995f57 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:08.370627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c2588-466b-4517-b63c-350118995f57 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:08.370627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c2588-466b-4517-b63c-350118995f57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:08.371413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c2588-466b-4517-b63c-350118995f57 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:08.379631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:08.381583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 321/647] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:08.382311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c2588-466b-4517-b63c-350118995f57 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:08.508480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97323499-d329-42ca-9ecb-846c1aba3a03 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:08.528296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c2588-466b-4517-b63c-350118995f57 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:08.547474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e9624-2b9d-4d38-8ccb-76ff287aa2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:08.548154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e9624-2b9d-4d38-8ccb-76ff287aa2ea None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:08.548456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e9624-2b9d-4d38-8ccb-76ff287aa2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:08.548733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e9624-2b9d-4d38-8ccb-76ff287aa2ea None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:08.549671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e9624-2b9d-4d38-8ccb-76ff287aa2ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:08.549860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e9624-2b9d-4d38-8ccb-76ff287aa2ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:08.551242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e9624-2b9d-4d38-8ccb-76ff287aa2ea None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:08.564971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 327/648] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:08.570403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e9624-2b9d-4d38-8ccb-76ff287aa2ea None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:08.571712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:08.581469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c08c1-65b7-41fa-827e-0d071ff6dc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:08.582330 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c08c1-65b7-41fa-827e-0d071ff6dc17 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:08.582615 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c08c1-65b7-41fa-827e-0d071ff6dc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:08.582890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c08c1-65b7-41fa-827e-0d071ff6dc17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:08.595040 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c08c1-65b7-41fa-827e-0d071ff6dc17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:08.596906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c08c1-65b7-41fa-827e-0d071ff6dc17 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-aa2c08c1-65b7-41fa-827e-0d071ff6dc17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:08.616831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:08.617942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:08.623874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:08.623874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:08.623874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:08.623874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:08.623874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 322/649] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:08.623874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c08c1-65b7-41fa-827e-0d071ff6dc17 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:08.697783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:08.723706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e9624-2b9d-4d38-8ccb-76ff287aa2ea None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:08.746637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c08c1-65b7-41fa-827e-0d071ff6dc17 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:08.787403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b23ed0-034b-446b-9848-6f018c7ed9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:08.787640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b23ed0-034b-446b-9848-6f018c7ed9ce None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:08.787950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b23ed0-034b-446b-9848-6f018c7ed9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:08.788198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b23ed0-034b-446b-9848-6f018c7ed9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:08.802071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b23ed0-034b-446b-9848-6f018c7ed9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:08.804172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b23ed0-034b-446b-9848-6f018c7ed9ce None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:08.808714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fedfc-138d-4d62-a89c-7f66558e2c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:08.809605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fedfc-138d-4d62-a89c-7f66558e2c51 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:08.809967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fedfc-138d-4d62-a89c-7f66558e2c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:08.810306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fedfc-138d-4d62-a89c-7f66558e2c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:08.824684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fedfc-138d-4d62-a89c-7f66558e2c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:08.826144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fedfc-138d-4d62-a89c-7f66558e2c51 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-96b23ed0-034b-446b-9848-6f018c7ed9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:08.826474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:08.827410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:08.828390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:08.828390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:08.828390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:08.828390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:08.828390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 328/650] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:08.828671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b23ed0-034b-446b-9848-6f018c7ed9ce None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-466fedfc-138d-4d62-a89c-7f66558e2c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:08.852951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:08.853948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:08.854897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:08.854897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:08.854897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:08.854897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:08.854897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 323/651] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:08.855616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fedfc-138d-4d62-a89c-7f66558e2c51 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:08.889650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:08.945004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b23ed0-034b-446b-9848-6f018c7ed9ce None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:08.970435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fedfc-138d-4d62-a89c-7f66558e2c51 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:08.975184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:08.982593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe2cd3-198d-4470-86f1-8a150a609a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:08.983642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2cd3-198d-4470-86f1-8a150a609a01 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:08.984066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2cd3-198d-4470-86f1-8a150a609a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:08.984339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2cd3-198d-4470-86f1-8a150a609a01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:08.992163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe2cd3-198d-4470-86f1-8a150a609a01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:08.993681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe2cd3-198d-4470-86f1-8a150a609a01 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-43fe2cd3-198d-4470-86f1-8a150a609a01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:09.009053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:09.010075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:09.011022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:09.011022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:09.011022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:09.011022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:09.011022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:09.011022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:09.011022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:09.011022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:09.011022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 329/652] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:09.011606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe2cd3-198d-4470-86f1-8a150a609a01 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.021670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7486578-1f8e-469e-9fac-cd1640a02aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.023065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7486578-1f8e-469e-9fac-cd1640a02aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.023597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7486578-1f8e-469e-9fac-cd1640a02aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.024084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7486578-1f8e-469e-9fac-cd1640a02aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.025037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7486578-1f8e-469e-9fac-cd1640a02aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:09.025665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7486578-1f8e-469e-9fac-cd1640a02aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.028242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7486578-1f8e-469e-9fac-cd1640a02aa9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.052886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 324/653] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:09.052886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7486578-1f8e-469e-9fac-cd1640a02aa9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.141901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe2cd3-198d-4470-86f1-8a150a609a01 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:09.153306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:09.164635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7486578-1f8e-469e-9fac-cd1640a02aa9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:09.181050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0945e2-bb7a-481a-a561-53b31e133df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.181757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0945e2-bb7a-481a-a561-53b31e133df9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.182040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0945e2-bb7a-481a-a561-53b31e133df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.182352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0945e2-bb7a-481a-a561-53b31e133df9 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.183079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0945e2-bb7a-481a-a561-53b31e133df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:09.183385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0945e2-bb7a-481a-a561-53b31e133df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.184809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0945e2-bb7a-481a-a561-53b31e133df9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.199799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 330/654] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:09.199799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0945e2-bb7a-481a-a561-53b31e133df9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.207385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c8cad-b91b-4929-a733-d9e6195737d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.208085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c8cad-b91b-4929-a733-d9e6195737d7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.208478 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c8cad-b91b-4929-a733-d9e6195737d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.208816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c8cad-b91b-4929-a733-d9e6195737d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.209568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c8cad-b91b-4929-a733-d9e6195737d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:09.209884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c8cad-b91b-4929-a733-d9e6195737d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.211370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c8cad-b91b-4929-a733-d9e6195737d7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.225125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 325/655] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:09.226026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c8cad-b91b-4929-a733-d9e6195737d7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.274326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:09.325962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0945e2-bb7a-481a-a561-53b31e133df9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:09.347642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c8cad-b91b-4929-a733-d9e6195737d7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:09.361523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef913ac-7d44-4ef9-a511-aa4093e9546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.362249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef913ac-7d44-4ef9-a511-aa4093e9546b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.362885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef913ac-7d44-4ef9-a511-aa4093e9546b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.363164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef913ac-7d44-4ef9-a511-aa4093e9546b None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.363955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef913ac-7d44-4ef9-a511-aa4093e9546b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:09.364276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef913ac-7d44-4ef9-a511-aa4093e9546b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.365879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef913ac-7d44-4ef9-a511-aa4093e9546b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.378888 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 331/656] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:09.380300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1f70-729a-4045-b5be-01e9b2e08d0c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.380592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1f70-729a-4045-b5be-01e9b2e08d0c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.380867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1f70-729a-4045-b5be-01e9b2e08d0c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.382228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 332/657] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:09.382943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1f70-729a-4045-b5be-01e9b2e08d0c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.388223 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3227e0-a367-4968-a2f7-cee96c78f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.389063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3227e0-a367-4968-a2f7-cee96c78f848 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.389345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3227e0-a367-4968-a2f7-cee96c78f848 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.389614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3227e0-a367-4968-a2f7-cee96c78f848 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.398133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3227e0-a367-4968-a2f7-cee96c78f848 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.399533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3227e0-a367-4968-a2f7-cee96c78f848 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0c3227e0-a367-4968-a2f7-cee96c78f848 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:09.415697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:09.416862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 12:44:09.417938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:09.421792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 326/658] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:09.422575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3227e0-a367-4968-a2f7-cee96c78f848 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.435455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:09.498899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1f70-729a-4045-b5be-01e9b2e08d0c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:09.513556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:09.533691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3227e0-a367-4968-a2f7-cee96c78f848 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:09.537675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf44480-d314-4e87-8734-9a207344b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.538547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf44480-d314-4e87-8734-9a207344b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.538830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf44480-d314-4e87-8734-9a207344b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.539102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf44480-d314-4e87-8734-9a207344b3d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.546555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf44480-d314-4e87-8734-9a207344b3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.548082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf44480-d314-4e87-8734-9a207344b3d1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4bf44480-d314-4e87-8734-9a207344b3d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:09.568403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:09.569675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 333/659] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:09.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf44480-d314-4e87-8734-9a207344b3d1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.577308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b80c9-2b73-4679-bcfa-b79c1915ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.578275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b80c9-2b73-4679-bcfa-b79c1915ddcd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.578616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b80c9-2b73-4679-bcfa-b79c1915ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.578952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b80c9-2b73-4679-bcfa-b79c1915ddcd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.588909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b80c9-2b73-4679-bcfa-b79c1915ddcd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.591839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b80c9-2b73-4679-bcfa-b79c1915ddcd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b74b80c9-2b73-4679-bcfa-b79c1915ddcd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:09.607304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:09.608592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:09.609749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 327/660] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:09.610418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d61d-d2a7-4ef0-8655-4841efd9f9d8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.610495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d61d-d2a7-4ef0-8655-4841efd9f9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.610747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d61d-d2a7-4ef0-8655-4841efd9f9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.629708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0604d61d-d2a7-4ef0-8655-4841efd9f9d8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:09.631727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0604d61d-d2a7-4ef0-8655-4841efd9f9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:09.706925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf44480-d314-4e87-8734-9a207344b3d1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:09.707552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:09.714143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 328/661] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:09.715017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604d61d-d2a7-4ef0-8655-4841efd9f9d8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.761116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eef18-da52-4552-bffb-4d2365b6e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.762824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eef18-da52-4552-bffb-4d2365b6e04d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.763450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eef18-da52-4552-bffb-4d2365b6e04d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.763733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9eef18-da52-4552-bffb-4d2365b6e04d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.765916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eef18-da52-4552-bffb-4d2365b6e04d None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=09a967d14a7243068a016b4677e47234) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:09.766278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eef18-da52-4552-bffb-4d2365b6e04d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.769089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9eef18-da52-4552-bffb-4d2365b6e04d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.777560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 334/662] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/role_assignments?user.id=09a967d14a7243068a016b4677e47234&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:09.778455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eef18-da52-4552-bffb-4d2365b6e04d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.835286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:09.857139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604d61d-d2a7-4ef0-8655-4841efd9f9d8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:09.905359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0ce3-18fa-4bb0-b5d7-9eebacc1fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.907430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0ce3-18fa-4bb0-b5d7-9eebacc1fdde None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.907876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0ce3-18fa-4bb0-b5d7-9eebacc1fdde None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.908341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0ce3-18fa-4bb0-b5d7-9eebacc1fdde None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.909817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0ce3-18fa-4bb0-b5d7-9eebacc1fdde None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:09.910363 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0ce3-18fa-4bb0-b5d7-9eebacc1fdde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.912569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0ce3-18fa-4bb0-b5d7-9eebacc1fdde None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:09.934458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9eef18-da52-4552-bffb-4d2365b6e04d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:09.944505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 329/663] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:09.945964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0ce3-18fa-4bb0-b5d7-9eebacc1fdde None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:09.989340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4a5a8-89c9-40b5-8d1c-b225d7fb424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:09.990063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4a5a8-89c9-40b5-8d1c-b225d7fb424a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:09.990410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4a5a8-89c9-40b5-8d1c-b225d7fb424a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:09.990670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4a5a8-89c9-40b5-8d1c-b225d7fb424a None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:09.991482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4a5a8-89c9-40b5-8d1c-b225d7fb424a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:09.991790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4a5a8-89c9-40b5-8d1c-b225d7fb424a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:09.993322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4a5a8-89c9-40b5-8d1c-b225d7fb424a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:10.011242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 335/664] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:10.012259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4a5a8-89c9-40b5-8d1c-b225d7fb424a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:10.056388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:10.108442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0ce3-18fa-4bb0-b5d7-9eebacc1fdde None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:10.154139 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:10.158027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053473ce-1c5f-47ff-a9ea-f36d5ba44882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:10.158780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053473ce-1c5f-47ff-a9ea-f36d5ba44882 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:10.159056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053473ce-1c5f-47ff-a9ea-f36d5ba44882 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:10.159325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053473ce-1c5f-47ff-a9ea-f36d5ba44882 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:10.160186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053473ce-1c5f-47ff-a9ea-f36d5ba44882 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:10.160519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053473ce-1c5f-47ff-a9ea-f36d5ba44882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:10.162389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4a5a8-89c9-40b5-8d1c-b225d7fb424a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:10.162735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053473ce-1c5f-47ff-a9ea-f36d5ba44882 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:10.184892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 330/665] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 17 12:44:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:10.186151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053473ce-1c5f-47ff-a9ea-f36d5ba44882 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:10.214389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998e0e8-7e3a-429d-a1b1-19b2ab1c3c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:10.215214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e0e8-7e3a-429d-a1b1-19b2ab1c3c1c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:10.215579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e0e8-7e3a-429d-a1b1-19b2ab1c3c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:10.215880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e0e8-7e3a-429d-a1b1-19b2ab1c3c1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:10.230260 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998e0e8-7e3a-429d-a1b1-19b2ab1c3c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0998e0e8-7e3a-429d-a1b1-19b2ab1c3c1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:10.239001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:10.240968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 336/666] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:10.242645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998e0e8-7e3a-429d-a1b1-19b2ab1c3c1c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:10.327291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053473ce-1c5f-47ff-a9ea-f36d5ba44882 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:10.346626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:10.370542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f05a-4b1a-40b9-bf8f-3e54ad65dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:10.371240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f05a-4b1a-40b9-bf8f-3e54ad65dc3b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:10.371514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f05a-4b1a-40b9-bf8f-3e54ad65dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:10.371795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f05a-4b1a-40b9-bf8f-3e54ad65dc3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:10.374584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998e0e8-7e3a-429d-a1b1-19b2ab1c3c1c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:10.428417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ecb2-e646-4a5b-b86c-55e9ac5dbac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:10.429540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ecb2-e646-4a5b-b86c-55e9ac5dbac0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:10.430018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ecb2-e646-4a5b-b86c-55e9ac5dbac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:10.430518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ecb2-e646-4a5b-b86c-55e9ac5dbac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:10.432094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ecb2-e646-4a5b-b86c-55e9ac5dbac0 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=984780a6a8df405dbbb2ba4c46dd841c) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:10.432634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ecb2-e646-4a5b-b86c-55e9ac5dbac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:10.435438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ecb2-e646-4a5b-b86c-55e9ac5dbac0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:10.444904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 337/667] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:10 2022] GET /identity/v3/role_assignments?user.id=984780a6a8df405dbbb2ba4c46dd841c&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:10.446206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ecb2-e646-4a5b-b86c-55e9ac5dbac0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:10.472692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1f05a-4b1a-40b9-bf8f-3e54ad65dc3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:10.475320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1f05a-4b1a-40b9-bf8f-3e54ad65dc3b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:10.482973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:10.602545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ecb2-e646-4a5b-b86c-55e9ac5dbac0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:10.639020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 331/668] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:10.641162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f05a-4b1a-40b9-bf8f-3e54ad65dc3b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:10.652406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2121-9efd-43b1-afda-4a5ae6a4f1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:10.653114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2121-9efd-43b1-afda-4a5ae6a4f1ba None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:10.653396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2121-9efd-43b1-afda-4a5ae6a4f1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:10.653675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2121-9efd-43b1-afda-4a5ae6a4f1ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:10.662825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:10.755370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2121-9efd-43b1-afda-4a5ae6a4f1ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:10.756967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2121-9efd-43b1-afda-4a5ae6a4f1ba None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:10.781109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f05a-4b1a-40b9-bf8f-3e54ad65dc3b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:10.790005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:10.819788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8e079-d84a-4481-8c3c-111774a18609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:10.820886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8e079-d84a-4481-8c3c-111774a18609 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:10.821366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8e079-d84a-4481-8c3c-111774a18609 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:10.821840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8e079-d84a-4481-8c3c-111774a18609 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:10.822853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8e079-d84a-4481-8c3c-111774a18609 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:10.823380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8e079-d84a-4481-8c3c-111774a18609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:10.825116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8e079-d84a-4481-8c3c-111774a18609 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:10.835456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 332/669] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:10.841177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8e079-d84a-4481-8c3c-111774a18609 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:10.887455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 338/670] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:10.888606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2121-9efd-43b1-afda-4a5ae6a4f1ba None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:10.959188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:11.005628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8e079-d84a-4481-8c3c-111774a18609 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.018294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2121-9efd-43b1-afda-4a5ae6a4f1ba None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.044914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:11.062251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364d4bb-62d8-4068-840f-7d2d91b2f22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.063149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364d4bb-62d8-4068-840f-7d2d91b2f22c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.063436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364d4bb-62d8-4068-840f-7d2d91b2f22c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.063717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364d4bb-62d8-4068-840f-7d2d91b2f22c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.073366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536deda-a503-4c77-a22d-ae5c33292268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.075222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536deda-a503-4c77-a22d-ae5c33292268 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.075941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536deda-a503-4c77-a22d-ae5c33292268 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.076111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364d4bb-62d8-4068-840f-7d2d91b2f22c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.076832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536deda-a503-4c77-a22d-ae5c33292268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.077567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364d4bb-62d8-4068-840f-7d2d91b2f22c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:11.094068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536deda-a503-4c77-a22d-ae5c33292268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.095626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536deda-a503-4c77-a22d-ae5c33292268 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d364d4bb-62d8-4068-840f-7d2d91b2f22c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:11.110729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:11.112258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:11.118388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:11.118388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:11.118388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:11.118388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:11.118388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 339/671] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b536deda-a503-4c77-a22d-ae5c33292268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:11.118703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:11.119510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:11.120395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:11.120395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:11.120395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:11.120395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:11.120609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364d4bb-62d8-4068-840f-7d2d91b2f22c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:11.120686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 333/672] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:11.127453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536deda-a503-4c77-a22d-ae5c33292268 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:11.260066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364d4bb-62d8-4068-840f-7d2d91b2f22c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.268344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536deda-a503-4c77-a22d-ae5c33292268 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.299717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52b116-27d1-44f9-a8f7-99e2653d5006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.300902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52b116-27d1-44f9-a8f7-99e2653d5006 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.301278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52b116-27d1-44f9-a8f7-99e2653d5006 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.301626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52b116-27d1-44f9-a8f7-99e2653d5006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.308816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:11.321920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238977-43f0-4e6e-bdd1-e529e50415ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.323412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52b116-27d1-44f9-a8f7-99e2653d5006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.326029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52b116-27d1-44f9-a8f7-99e2653d5006 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:11.327238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238977-43f0-4e6e-bdd1-e529e50415ed None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.327807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238977-43f0-4e6e-bdd1-e529e50415ed None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.328283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92238977-43f0-4e6e-bdd1-e529e50415ed None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.329540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92238977-43f0-4e6e-bdd1-e529e50415ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:11.330538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92238977-43f0-4e6e-bdd1-e529e50415ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.332178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92238977-43f0-4e6e-bdd1-e529e50415ed None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:11.357923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 334/673] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:11.357923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238977-43f0-4e6e-bdd1-e529e50415ed None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9e52b116-27d1-44f9-a8f7-99e2653d5006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:11.364938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:11.366393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:11.367286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:11.367286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:11.367286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:11.367286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:11.367964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 340/674] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:11.369149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52b116-27d1-44f9-a8f7-99e2653d5006 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:11.404915 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:11.486212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92238977-43f0-4e6e-bdd1-e529e50415ed None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.494855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52b116-27d1-44f9-a8f7-99e2653d5006 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.527813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285e1e-15df-44ac-be50-719bc2079f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.528853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285e1e-15df-44ac-be50-719bc2079f94 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.529341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285e1e-15df-44ac-be50-719bc2079f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.529821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285e1e-15df-44ac-be50-719bc2079f94 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.530836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285e1e-15df-44ac-be50-719bc2079f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:11.531354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285e1e-15df-44ac-be50-719bc2079f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.533210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285e1e-15df-44ac-be50-719bc2079f94 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:11.536035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef46b6-61fb-4be4-80db-a06f8dcc699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.537449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef46b6-61fb-4be4-80db-a06f8dcc699a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.537449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef46b6-61fb-4be4-80db-a06f8dcc699a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.537736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef46b6-61fb-4be4-80db-a06f8dcc699a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.545672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef46b6-61fb-4be4-80db-a06f8dcc699a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.547348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef46b6-61fb-4be4-80db-a06f8dcc699a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:11.549547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 335/675] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:11.550963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285e1e-15df-44ac-be50-719bc2079f94 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-11ef46b6-61fb-4be4-80db-a06f8dcc699a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:11.564860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:11.565835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:11.566772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:11.566772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:11.566772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:11.566772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:11.566772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:11.566772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:11.566772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:11.566772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:11.571735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 341/676] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:11.572901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef46b6-61fb-4be4-80db-a06f8dcc699a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:11.625785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:11.679589 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:11.699812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef46b6-61fb-4be4-80db-a06f8dcc699a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.705579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285e1e-15df-44ac-be50-719bc2079f94 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.747197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e28c-e3fc-4cf6-9750-ea829147d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.748553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e28c-e3fc-4cf6-9750-ea829147d8ea None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.749016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e28c-e3fc-4cf6-9750-ea829147d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.749479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e28c-e3fc-4cf6-9750-ea829147d8ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.752164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503aee-b91f-4d00-917c-1bb27a66e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.753318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503aee-b91f-4d00-917c-1bb27a66e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.753819 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503aee-b91f-4d00-917c-1bb27a66e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.754332 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503aee-b91f-4d00-917c-1bb27a66e1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.755476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35503aee-b91f-4d00-917c-1bb27a66e1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:11.756341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35503aee-b91f-4d00-917c-1bb27a66e1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.758072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35503aee-b91f-4d00-917c-1bb27a66e1a2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:11.764717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e28c-e3fc-4cf6-9750-ea829147d8ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.767368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e28c-e3fc-4cf6-9750-ea829147d8ea None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:11.775756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 336/677] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:11.777055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503aee-b91f-4d00-917c-1bb27a66e1a2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-dc60e28c-e3fc-4cf6-9750-ea829147d8ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:11.801182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:11.802275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:11.803739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 342/678] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:11.805124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e28c-e3fc-4cf6-9750-ea829147d8ea None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:11.912780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503aee-b91f-4d00-917c-1bb27a66e1a2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.931651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e28c-e3fc-4cf6-9750-ea829147d8ea None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:11.932649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:11.961319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c055b-0c8e-43b4-9077-556d7fc6549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.962511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c055b-0c8e-43b4-9077-556d7fc6549c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.963058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c055b-0c8e-43b4-9077-556d7fc6549c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.963534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c055b-0c8e-43b4-9077-556d7fc6549c None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.964552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c055b-0c8e-43b4-9077-556d7fc6549c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:11.965258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c055b-0c8e-43b4-9077-556d7fc6549c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.966985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c055b-0c8e-43b4-9077-556d7fc6549c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:11.974008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0bba-4012-4ad0-9a74-89cf1ea4fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:11.974914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0bba-4012-4ad0-9a74-89cf1ea4fc0e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:11.975200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0bba-4012-4ad0-9a74-89cf1ea4fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:11.975483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0bba-4012-4ad0-9a74-89cf1ea4fc0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:11.983990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 337/679] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:11.985228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c055b-0c8e-43b4-9077-556d7fc6549c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:11.989344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd0bba-4012-4ad0-9a74-89cf1ea4fc0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:11.991520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd0bba-4012-4ad0-9a74-89cf1ea4fc0e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-75dd0bba-4012-4ad0-9a74-89cf1ea4fc0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:12.009618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:12.010694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:12.011804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:12.011804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:12.011804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:12.011804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:12.011804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:12.011804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:12.011804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:12.011804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:12.016063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 343/680] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:12.017211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0bba-4012-4ad0-9a74-89cf1ea4fc0e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:12.022255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:12.107821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c055b-0c8e-43b4-9077-556d7fc6549c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:12.144201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0bba-4012-4ad0-9a74-89cf1ea4fc0e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:12.151199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6077f-bbbf-45ca-8bb4-582f0982ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:12.152476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6077f-bbbf-45ca-8bb4-582f0982ca6e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:12.152980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6077f-bbbf-45ca-8bb4-582f0982ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:12.153562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6077f-bbbf-45ca-8bb4-582f0982ca6e None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:12.154734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6077f-bbbf-45ca-8bb4-582f0982ca6e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:12.155291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6077f-bbbf-45ca-8bb4-582f0982ca6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:12.157159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6077f-bbbf-45ca-8bb4-582f0982ca6e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:12.178956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 338/681] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 12:44:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:12.180192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6077f-bbbf-45ca-8bb4-582f0982ca6e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:12.188157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2286e-aa3d-4cdb-bf3f-405128b66b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:12.188898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2286e-aa3d-4cdb-bf3f-405128b66b00 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:12.189187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2286e-aa3d-4cdb-bf3f-405128b66b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:12.189466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2286e-aa3d-4cdb-bf3f-405128b66b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:12.190355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2286e-aa3d-4cdb-bf3f-405128b66b00 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=688ecef411094633927ffd663ffa1818) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:12.190680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2286e-aa3d-4cdb-bf3f-405128b66b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:12.192296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2286e-aa3d-4cdb-bf3f-405128b66b00 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:12.206396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 344/682] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:12 2022] GET /identity/v3/role_assignments?user.id=688ecef411094633927ffd663ffa1818&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:12.207557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2286e-aa3d-4cdb-bf3f-405128b66b00 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:12.228872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:12.296292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:12.334463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6077f-bbbf-45ca-8bb4-582f0982ca6e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:12.340665 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2286e-aa3d-4cdb-bf3f-405128b66b00 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:12.383729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861044a7-7d78-47d4-af1f-d045f1da0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:12.384431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861044a7-7d78-47d4-af1f-d045f1da0f78 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:12.384709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861044a7-7d78-47d4-af1f-d045f1da0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:12.384995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861044a7-7d78-47d4-af1f-d045f1da0f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:12.420890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31380b6c-9ab8-4bfd-be6e-637ab951d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:12.422170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31380b6c-9ab8-4bfd-be6e-637ab951d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:12.422693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31380b6c-9ab8-4bfd-be6e-637ab951d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:12.423218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31380b6c-9ab8-4bfd-be6e-637ab951d1a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:12.424816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31380b6c-9ab8-4bfd-be6e-637ab951d1a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:12.425394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31380b6c-9ab8-4bfd-be6e-637ab951d1a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:12.428370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31380b6c-9ab8-4bfd-be6e-637ab951d1a8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:12.455419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 339/683] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:12.457916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d9498-2ea9-49b2-bed6-38eefd9ca276 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:12.458918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d9498-2ea9-49b2-bed6-38eefd9ca276 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:12.459464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d9498-2ea9-49b2-bed6-38eefd9ca276 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:12.466170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 340/684] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:12.466170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d9498-2ea9-49b2-bed6-38eefd9ca276 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:12.492328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861044a7-7d78-47d4-af1f-d045f1da0f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:12.494063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861044a7-7d78-47d4-af1f-d045f1da0f78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:12.632839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:12.645348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:12.671086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d9498-2ea9-49b2-bed6-38eefd9ca276 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:12.706923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 345/685] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:12.710261 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bcbf6-2f79-41ed-a083-4b6ff63ba5ec None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:12.710719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bcbf6-2f79-41ed-a083-4b6ff63ba5ec None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:12.711172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bcbf6-2f79-41ed-a083-4b6ff63ba5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:12.739301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be213a-c57b-4cd9-bd2d-889f54da1d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:12.740414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be213a-c57b-4cd9-bd2d-889f54da1d07 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:12.740546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-323bcbf6-2f79-41ed-a083-4b6ff63ba5ec None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:12.741069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be213a-c57b-4cd9-bd2d-889f54da1d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:12.741508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be213a-c57b-4cd9-bd2d-889f54da1d07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:12.742457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-323bcbf6-2f79-41ed-a083-4b6ff63ba5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:12.743077 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be213a-c57b-4cd9-bd2d-889f54da1d07 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=68fc7c689f3645149d927663730bab5e) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:12.743620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be213a-c57b-4cd9-bd2d-889f54da1d07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:12.746562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be213a-c57b-4cd9-bd2d-889f54da1d07 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:12.762225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 341/686] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:12 2022] GET /identity/v3/role_assignments?user.id=68fc7c689f3645149d927663730bab5e&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:12.763827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be213a-c57b-4cd9-bd2d-889f54da1d07 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:12.881266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 346/687] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:12.918136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bcbf6-2f79-41ed-a083-4b6ff63ba5ec None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:12.966826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be213a-c57b-4cd9-bd2d-889f54da1d07 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:13.008844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945fa02-08a5-415e-8c04-5b1df308b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:13.009746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945fa02-08a5-415e-8c04-5b1df308b75a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.010070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945fa02-08a5-415e-8c04-5b1df308b75a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.010430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945fa02-08a5-415e-8c04-5b1df308b75a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.024241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945fa02-08a5-415e-8c04-5b1df308b75a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:13.025886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945fa02-08a5-415e-8c04-5b1df308b75a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a945fa02-08a5-415e-8c04-5b1df308b75a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:13.047070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:13.049133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:13.050050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:13.050050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:13.050050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:13.050050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:13.050050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 342/688] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:13.056795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945fa02-08a5-415e-8c04-5b1df308b75a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:13.061042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:13.161934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:13.173759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bcbf6-2f79-41ed-a083-4b6ff63ba5ec None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:13.207423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945fa02-08a5-415e-8c04-5b1df308b75a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:13.238251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f618-0c6a-4603-b2f4-2dadad0f9865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:13.240427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f618-0c6a-4603-b2f4-2dadad0f9865 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.240900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f618-0c6a-4603-b2f4-2dadad0f9865 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.241789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f618-0c6a-4603-b2f4-2dadad0f9865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.258490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b67c61-fce9-4497-a39e-c57652d02772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:13.259667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b67c61-fce9-4497-a39e-c57652d02772 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.260170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b67c61-fce9-4497-a39e-c57652d02772 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.260664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b67c61-fce9-4497-a39e-c57652d02772 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.260985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f618-0c6a-4603-b2f4-2dadad0f9865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:13.261886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b67c61-fce9-4497-a39e-c57652d02772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:13.262486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b67c61-fce9-4497-a39e-c57652d02772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:13.264164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b67c61-fce9-4497-a39e-c57652d02772 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6514f618-0c6a-4603-b2f4-2dadad0f9865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:13.269628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:13.271884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 347/689] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:13.273383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624450f-ddc4-4c49-8c57-58b764b09f98 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.276871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624450f-ddc4-4c49-8c57-58b764b09f98 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.276871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624450f-ddc4-4c49-8c57-58b764b09f98 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.276871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 348/690] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:13.283783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb5378-8525-4235-b730-02d45613de46 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.284076 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb5378-8525-4235-b730-02d45613de46 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.284356 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb5378-8525-4235-b730-02d45613de46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.288681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 343/691] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:13.289417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b67c61-fce9-4497-a39e-c57652d02772 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:13.313438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6beb5378-8525-4235-b730-02d45613de46 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:13.314692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6beb5378-8525-4235-b730-02d45613de46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:13.359995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:13.402861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 349/692] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:44:13.410313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb5378-8525-4235-b730-02d45613de46 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:13.413348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b67c61-fce9-4497-a39e-c57652d02772 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:13.474468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d869e3-634d-4d56-adc0-273cce3c18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:13.476162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d869e3-634d-4d56-adc0-273cce3c18a0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.476699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d869e3-634d-4d56-adc0-273cce3c18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.477228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d869e3-634d-4d56-adc0-273cce3c18a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.478601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d869e3-634d-4d56-adc0-273cce3c18a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:13.479128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d869e3-634d-4d56-adc0-273cce3c18a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:13.481868 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d869e3-634d-4d56-adc0-273cce3c18a0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:13.500028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 344/693] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:13.500028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d869e3-634d-4d56-adc0-273cce3c18a0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:13.513900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:13.531784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb5378-8525-4235-b730-02d45613de46 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:13.578146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da6ee1-e73d-475d-938c-ade815bcf92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:13.579018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da6ee1-e73d-475d-938c-ade815bcf92b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.579995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da6ee1-e73d-475d-938c-ade815bcf92b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.579995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da6ee1-e73d-475d-938c-ade815bcf92b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.588879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da6ee1-e73d-475d-938c-ade815bcf92b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:13.590797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da6ee1-e73d-475d-938c-ade815bcf92b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-61da6ee1-e73d-475d-938c-ade815bcf92b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:13.608450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:13.609485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:13.610399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:13.610399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:13.610399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:13.610399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:13.610399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:13.610399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:13.610399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:13.610399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:13.614603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 350/694] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:13.615788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da6ee1-e73d-475d-938c-ade815bcf92b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:13.669689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d869e3-634d-4d56-adc0-273cce3c18a0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:13.709264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:13.723335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dc04c-e1bb-439f-948d-ae0a79f140c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:13.724623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc04c-e1bb-439f-948d-ae0a79f140c2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.724846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc04c-e1bb-439f-948d-ae0a79f140c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.725125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc04c-e1bb-439f-948d-ae0a79f140c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.741388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dc04c-e1bb-439f-948d-ae0a79f140c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:13.743369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dc04c-e1bb-439f-948d-ae0a79f140c2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:13.762803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da6ee1-e73d-475d-938c-ade815bcf92b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7f8dc04c-e1bb-439f-948d-ae0a79f140c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:13.769725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:13.770836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:13.777036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:13.777036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:13.777036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:13.777036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:13.777036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 345/695] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:13.777036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dc04c-e1bb-439f-948d-ae0a79f140c2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:13.841331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35010b-1737-4683-9194-7d1b7c20f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:13.842676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35010b-1737-4683-9194-7d1b7c20f8ee None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.843161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35010b-1737-4683-9194-7d1b7c20f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.843647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35010b-1737-4683-9194-7d1b7c20f8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.866228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35010b-1737-4683-9194-7d1b7c20f8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:13.869258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35010b-1737-4683-9194-7d1b7c20f8ee None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:13.886799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5c35010b-1737-4683-9194-7d1b7c20f8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:13.909407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:13.910461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:13.911615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:13.911615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:13.911615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:13.911615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:13.918632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 351/696] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:13.920353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35010b-1737-4683-9194-7d1b7c20f8ee None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:13.932885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dc04c-e1bb-439f-948d-ae0a79f140c2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:13.981987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1222-3db8-4fd9-8770-5bf2bbd5f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:13.983079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1222-3db8-4fd9-8770-5bf2bbd5f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:13.983568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1222-3db8-4fd9-8770-5bf2bbd5f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:13.984039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1222-3db8-4fd9-8770-5bf2bbd5f2e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:13.985511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d1222-3db8-4fd9-8770-5bf2bbd5f2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:13.986934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d1222-3db8-4fd9-8770-5bf2bbd5f2e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:13.989683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d1222-3db8-4fd9-8770-5bf2bbd5f2e0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:14.018874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 346/697] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:14.020275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1222-3db8-4fd9-8770-5bf2bbd5f2e0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:14.076153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35010b-1737-4683-9194-7d1b7c20f8ee None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:14.102726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:14.123394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0bbb-49be-4530-bfb1-43a815ad6f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:14.124622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0bbb-49be-4530-bfb1-43a815ad6f05 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:14.125109 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0bbb-49be-4530-bfb1-43a815ad6f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:14.125947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0bbb-49be-4530-bfb1-43a815ad6f05 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:14.126978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b0bbb-49be-4530-bfb1-43a815ad6f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:14.127538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b0bbb-49be-4530-bfb1-43a815ad6f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:14.129178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b0bbb-49be-4530-bfb1-43a815ad6f05 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:14.152663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 352/698] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:14.152663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0bbb-49be-4530-bfb1-43a815ad6f05 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:14.206387 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1222-3db8-4fd9-8770-5bf2bbd5f2e0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:14.234124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:14.259570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb35f77-2801-450d-884e-89f6862ca5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:14.261221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb35f77-2801-450d-884e-89f6862ca5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:14.261735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb35f77-2801-450d-884e-89f6862ca5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:14.262494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb35f77-2801-450d-884e-89f6862ca5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:14.263311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb35f77-2801-450d-884e-89f6862ca5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:14.263705 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb35f77-2801-450d-884e-89f6862ca5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:14.265465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb35f77-2801-450d-884e-89f6862ca5a7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:14.285738 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 347/699] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:14.287261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb35f77-2801-450d-884e-89f6862ca5a7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:14.299796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0bbb-49be-4530-bfb1-43a815ad6f05 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:14.354441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da881-9b54-4964-8100-7e1d076e350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:14.355038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da881-9b54-4964-8100-7e1d076e350d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:14.355334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da881-9b54-4964-8100-7e1d076e350d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:14.355603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2da881-9b54-4964-8100-7e1d076e350d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:14.356666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2da881-9b54-4964-8100-7e1d076e350d None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=ed5fff4bed294d16a0e1d5fec4991c58) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:14.357032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2da881-9b54-4964-8100-7e1d076e350d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:14.359137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2da881-9b54-4964-8100-7e1d076e350d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:14.374291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 353/700] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:14 2022] GET /identity/v3/role_assignments?user.id=ed5fff4bed294d16a0e1d5fec4991c58&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:14.375394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da881-9b54-4964-8100-7e1d076e350d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:14.446537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:14.453673 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb35f77-2801-450d-884e-89f6862ca5a7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:14.521804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7390169-8e88-4859-b0f6-438d1a827ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:14.522031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7390169-8e88-4859-b0f6-438d1a827ff6 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:14.522318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7390169-8e88-4859-b0f6-438d1a827ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:14.522600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7390169-8e88-4859-b0f6-438d1a827ff6 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:14.523335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7390169-8e88-4859-b0f6-438d1a827ff6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:14.525084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7390169-8e88-4859-b0f6-438d1a827ff6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:14.561645 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 348/701] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:44:14 2022] POST /identity/v3/users => generated 254 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:44:14.604366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2da881-9b54-4964-8100-7e1d076e350d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:14.634637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:14.647377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b374ca1-7738-4f0d-b413-b94decaacd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:14.648226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b374ca1-7738-4f0d-b413-b94decaacd80 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:14.648544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b374ca1-7738-4f0d-b413-b94decaacd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:14.648822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b374ca1-7738-4f0d-b413-b94decaacd80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:14.657969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b374ca1-7738-4f0d-b413-b94decaacd80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:14.659551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b374ca1-7738-4f0d-b413-b94decaacd80 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6b374ca1-7738-4f0d-b413-b94decaacd80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:14.682769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:14.683913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:14.685024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 354/702] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 12:44:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:14.692536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7390169-8e88-4859-b0f6-438d1a827ff6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:14.850470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7390169-8e88-4859-b0f6-438d1a827ff6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:14.899610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5439-570d-4482-ab29-b7a8a46bc36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:14.900804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5439-570d-4482-ab29-b7a8a46bc36c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:14.901176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5439-570d-4482-ab29-b7a8a46bc36c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:14.901456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5439-570d-4482-ab29-b7a8a46bc36c None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:14.903007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d5439-570d-4482-ab29-b7a8a46bc36c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:14.903007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d5439-570d-4482-ab29-b7a8a46bc36c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:14.904170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d5439-570d-4482-ab29-b7a8a46bc36c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:14.932311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 349/703] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 12:44:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:14.938971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b374ca1-7738-4f0d-b413-b94decaacd80 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:15.190975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b374ca1-7738-4f0d-b413-b94decaacd80 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:15.275328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0578af-eca7-45dc-8ea5-add78c9dbc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:15.276425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0578af-eca7-45dc-8ea5-add78c9dbc43 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:15.276902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0578af-eca7-45dc-8ea5-add78c9dbc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:15.277371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0578af-eca7-45dc-8ea5-add78c9dbc43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:15.374527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:15.416184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0578af-eca7-45dc-8ea5-add78c9dbc43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:15.419131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0578af-eca7-45dc-8ea5-add78c9dbc43 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:15.639883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 355/704] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 12:44:15.648654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5439-570d-4482-ab29-b7a8a46bc36c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:15.696733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:15.823615 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5439-570d-4482-ab29-b7a8a46bc36c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:15.859697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64fd8c-de19-463d-a6c4-e019eb643246 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:15.860077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64fd8c-de19-463d-a6c4-e019eb643246 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:15.860284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64fd8c-de19-463d-a6c4-e019eb643246 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:15.864072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 356/705] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:15.871704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd06bcf-836d-4a0b-9d31-785166ce0777 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:15.872026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd06bcf-836d-4a0b-9d31-785166ce0777 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:15.872256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd06bcf-836d-4a0b-9d31-785166ce0777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:15.887768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca69c95-e0d7-443f-874e-853bdf0e8e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:15.889249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca69c95-e0d7-443f-874e-853bdf0e8e2d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:15.889724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca69c95-e0d7-443f-874e-853bdf0e8e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:15.890366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca69c95-e0d7-443f-874e-853bdf0e8e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:15.919088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca69c95-e0d7-443f-874e-853bdf0e8e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:15.921816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca69c95-e0d7-443f-874e-853bdf0e8e2d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:15.924087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2bd06bcf-836d-4a0b-9d31-785166ce0777 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:15.925980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2bd06bcf-836d-4a0b-9d31-785166ce0777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2ca69c95-e0d7-443f-874e-853bdf0e8e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:15.982841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:15.983897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:15.984831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:15.984831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:15.984831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:15.984831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:15.989204 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 350/706] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:15.995802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca69c95-e0d7-443f-874e-853bdf0e8e2d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:16.063653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 357/707] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:16.093520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd06bcf-836d-4a0b-9d31-785166ce0777 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:16.116561 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:16.220782 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd06bcf-836d-4a0b-9d31-785166ce0777 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:16.254510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:16.266701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef417dc-1912-4eb2-94c5-796529f8d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:16.269479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef417dc-1912-4eb2-94c5-796529f8d09b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:16.270059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef417dc-1912-4eb2-94c5-796529f8d09b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:16.270586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef417dc-1912-4eb2-94c5-796529f8d09b None admin] PATH_INFO: `/v3/services/network` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:16.271573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef417dc-1912-4eb2-94c5-796529f8d09b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:16.273253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef417dc-1912-4eb2-94c5-796529f8d09b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-bef417dc-1912-4eb2-94c5-796529f8d09b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:16.291186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:16.292694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 12:44:16.293516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:16.296827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 358/708] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:16 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:16.298654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe46a0d-732e-4869-865f-554e9d46bc77 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:16.299175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe46a0d-732e-4869-865f-554e9d46bc77 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:16.299663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe46a0d-732e-4869-865f-554e9d46bc77 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:16.301765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 359/709] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:16.302958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe46a0d-732e-4869-865f-554e9d46bc77 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:16.341508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca69c95-e0d7-443f-874e-853bdf0e8e2d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:16.403037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cf60a-c580-46ac-a0f1-95cd6e3b380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:16.404220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cf60a-c580-46ac-a0f1-95cd6e3b380a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:16.404813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cf60a-c580-46ac-a0f1-95cd6e3b380a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:16.405286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cf60a-c580-46ac-a0f1-95cd6e3b380a None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:16.406932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:16.408226 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cf60a-c580-46ac-a0f1-95cd6e3b380a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:16.408960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cf60a-c580-46ac-a0f1-95cd6e3b380a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:16.411619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cf60a-c580-46ac-a0f1-95cd6e3b380a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:16.434214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe46a0d-732e-4869-865f-554e9d46bc77 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:16.438403 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 351/710] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:16.440986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b62ce7-4812-47f7-b6d9-bcacd87d4ea5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:16.441466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b62ce7-4812-47f7-b6d9-bcacd87d4ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:16.441982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b62ce7-4812-47f7-b6d9-bcacd87d4ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:16.474645 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-20b62ce7-4812-47f7-b6d9-bcacd87d4ea5 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:16.476353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97705c-f7fc-482c-b83a-09fd17af8191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:16.476579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-20b62ce7-4812-47f7-b6d9-bcacd87d4ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:16.477549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97705c-f7fc-482c-b83a-09fd17af8191 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:16.478050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97705c-f7fc-482c-b83a-09fd17af8191 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:16.478549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97705c-f7fc-482c-b83a-09fd17af8191 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:16.479454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97705c-f7fc-482c-b83a-09fd17af8191 None admin] RBAC: Adding query filter params (name=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:16.479966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97705c-f7fc-482c-b83a-09fd17af8191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:16.481593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97705c-f7fc-482c-b83a-09fd17af8191 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:16.487364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 360/711] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:16.489005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97705c-f7fc-482c-b83a-09fd17af8191 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:16.603966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97705c-f7fc-482c-b83a-09fd17af8191 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:16.618335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 352/712] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:16.620066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b62ce7-4812-47f7-b6d9-bcacd87d4ea5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:16.649112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421635-fb74-4a12-bb22-326af8666d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:16.650463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421635-fb74-4a12-bb22-326af8666d8a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:16.650959 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421635-fb74-4a12-bb22-326af8666d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:16.651424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421635-fb74-4a12-bb22-326af8666d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:16.659929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e421635-fb74-4a12-bb22-326af8666d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:16.661941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e421635-fb74-4a12-bb22-326af8666d8a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0e421635-fb74-4a12-bb22-326af8666d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:16.679540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:16.680544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:16.681437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:16.681437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:16.681437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:16.681437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:16.681437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:16.681437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:16.681437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:16.681437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:16.684101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 361/713] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:16.691655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421635-fb74-4a12-bb22-326af8666d8a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:16.695376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:16.762923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:16.820522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421635-fb74-4a12-bb22-326af8666d8a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:16.853110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b62ce7-4812-47f7-b6d9-bcacd87d4ea5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:16.863176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d762c-05e1-4ab9-84d0-5b1543277dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:16.864014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d762c-05e1-4ab9-84d0-5b1543277dff None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:16.864388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d762c-05e1-4ab9-84d0-5b1543277dff None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:16.864794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d762c-05e1-4ab9-84d0-5b1543277dff None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:16.865744 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d762c-05e1-4ab9-84d0-5b1543277dff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:16.866232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d762c-05e1-4ab9-84d0-5b1543277dff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:16.867883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d762c-05e1-4ab9-84d0-5b1543277dff None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:16.882933 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 362/714] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:16.883969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d762c-05e1-4ab9-84d0-5b1543277dff None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:16.923787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456b63a-4afe-46c2-9b31-03d9a768cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:16.925377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456b63a-4afe-46c2-9b31-03d9a768cb7c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:16.926242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456b63a-4afe-46c2-9b31-03d9a768cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:16.927147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456b63a-4afe-46c2-9b31-03d9a768cb7c None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:16.928734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456b63a-4afe-46c2-9b31-03d9a768cb7c None admin] RBAC: Adding query filter params (type=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:16.929596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456b63a-4afe-46c2-9b31-03d9a768cb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:16.932650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456b63a-4afe-46c2-9b31-03d9a768cb7c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:16.944914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 353/715] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:16.947099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456b63a-4afe-46c2-9b31-03d9a768cb7c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:16.956802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:17.006025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d762c-05e1-4ab9-84d0-5b1543277dff None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:17.047424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c7212-aac1-44e9-8120-462883c79e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:17.047959 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7212-aac1-44e9-8120-462883c79e70 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:17.048236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7212-aac1-44e9-8120-462883c79e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:17.048509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7212-aac1-44e9-8120-462883c79e70 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:17.049186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c7212-aac1-44e9-8120-462883c79e70 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:17.050777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c7212-aac1-44e9-8120-462883c79e70 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d74c7212-aac1-44e9-8120-462883c79e70 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:17.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:17.068081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:17.069961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 363/716] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Jun 17 12:44:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:17.073745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c7212-aac1-44e9-8120-462883c79e70 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:17.166522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456b63a-4afe-46c2-9b31-03d9a768cb7c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:17.197356 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c7212-aac1-44e9-8120-462883c79e70 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:17.203711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:17.235900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:17.239613 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d961654-64b6-44b0-b308-ed86ebc6e505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:17.240888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d961654-64b6-44b0-b308-ed86ebc6e505 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:17.241548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d961654-64b6-44b0-b308-ed86ebc6e505 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:17.242570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d961654-64b6-44b0-b308-ed86ebc6e505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:17.244772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d961654-64b6-44b0-b308-ed86ebc6e505 None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=09a967d14a7243068a016b4677e47234) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:17.245389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d961654-64b6-44b0-b308-ed86ebc6e505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:17.247964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6139013-00de-44b9-81b8-c7a0d01d92d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:17.248128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d961654-64b6-44b0-b308-ed86ebc6e505 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:17.249090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6139013-00de-44b9-81b8-c7a0d01d92d7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:17.249562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6139013-00de-44b9-81b8-c7a0d01d92d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:17.250027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6139013-00de-44b9-81b8-c7a0d01d92d7 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:17.250964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6139013-00de-44b9-81b8-c7a0d01d92d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:17.251460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6139013-00de-44b9-81b8-c7a0d01d92d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:17.253887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6139013-00de-44b9-81b8-c7a0d01d92d7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:17.259930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 354/717] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:16 2022] GET /identity/v3/role_assignments?user.id=09a967d14a7243068a016b4677e47234&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:17.261333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 364/718] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 12:44:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:17.267862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d961654-64b6-44b0-b308-ed86ebc6e505 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:17.406518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d502b9f-6dbf-4943-9ac9-86dc4aafbc9f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:17.407562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d502b9f-6dbf-4943-9ac9-86dc4aafbc9f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:17.408034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d502b9f-6dbf-4943-9ac9-86dc4aafbc9f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:17.410075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 365/719] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:17.417900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bd760-1c12-4d66-8fca-c0e2910c7450 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:17.418570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bd760-1c12-4d66-8fca-c0e2910c7450 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:17.419062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bd760-1c12-4d66-8fca-c0e2910c7450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:17.441181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-450bd760-1c12-4d66-8fca-c0e2910c7450 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:17.443083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-450bd760-1c12-4d66-8fca-c0e2910c7450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:17.454845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d961654-64b6-44b0-b308-ed86ebc6e505 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:17.523342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e60d8-6b65-4ea7-8f44-bd6cb52c5831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:17.524274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e60d8-6b65-4ea7-8f44-bd6cb52c5831 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:17.524836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e60d8-6b65-4ea7-8f44-bd6cb52c5831 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:17.525241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e60d8-6b65-4ea7-8f44-bd6cb52c5831 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:17.526502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e60d8-6b65-4ea7-8f44-bd6cb52c5831 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:17.526979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e60d8-6b65-4ea7-8f44-bd6cb52c5831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:17.529981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e60d8-6b65-4ea7-8f44-bd6cb52c5831 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:17.538359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 366/720] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 12:44:17.542485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 355/721] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 12:44:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:17.573517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bd760-1c12-4d66-8fca-c0e2910c7450 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:17.796065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bd760-1c12-4d66-8fca-c0e2910c7450 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:17.826902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:17.846187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf97f8-8e4d-45fa-a1d6-94587a4bf623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:17.847160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf97f8-8e4d-45fa-a1d6-94587a4bf623 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:17.847530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf97f8-8e4d-45fa-a1d6-94587a4bf623 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:17.847844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf97f8-8e4d-45fa-a1d6-94587a4bf623 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:17.861331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf97f8-8e4d-45fa-a1d6-94587a4bf623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5cdf97f8-8e4d-45fa-a1d6-94587a4bf623 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:17.871023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:17.872162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:17.873005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:17.877506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 367/722] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:17.879361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e60d8-6b65-4ea7-8f44-bd6cb52c5831 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:17.979421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c62867-8343-4167-86a8-d54b23f1fbc1 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:17.979894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c62867-8343-4167-86a8-d54b23f1fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:17.980348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c62867-8343-4167-86a8-d54b23f1fbc1 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:17.983019 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 368/723] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:17.990315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:17.991013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410b51a-5b18-4852-a958-9744c7c77022 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:17.991481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410b51a-5b18-4852-a958-9744c7c77022 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:17.991949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410b51a-5b18-4852-a958-9744c7c77022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:18.041918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1410b51a-5b18-4852-a958-9744c7c77022 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:18.044202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1410b51a-5b18-4852-a958-9744c7c77022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:18.153760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e60d8-6b65-4ea7-8f44-bd6cb52c5831 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:18.232462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be279-051a-4a2c-88d4-314472f4f564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:18.235123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be279-051a-4a2c-88d4-314472f4f564 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:18.235634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be279-051a-4a2c-88d4-314472f4f564 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:18.236489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be279-051a-4a2c-88d4-314472f4f564 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:18.238484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be279-051a-4a2c-88d4-314472f4f564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:18.240657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be279-051a-4a2c-88d4-314472f4f564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:18.250466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 369/724] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:18.251273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be279-051a-4a2c-88d4-314472f4f564 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:18.261731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 356/725] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:18.270524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410b51a-5b18-4852-a958-9744c7c77022 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:18.280219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be279-051a-4a2c-88d4-314472f4f564 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:18.474874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410b51a-5b18-4852-a958-9744c7c77022 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:18.500515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:18.511306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be279-051a-4a2c-88d4-314472f4f564 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:18.527894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:18.562259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fc588-b903-4b1a-ad7f-1472d95a56bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:18.562587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf6f77-87be-4581-9ec0-ca2d2b143c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:18.563285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fc588-b903-4b1a-ad7f-1472d95a56bf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:18.563641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fc588-b903-4b1a-ad7f-1472d95a56bf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:18.563987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fc588-b903-4b1a-ad7f-1472d95a56bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:18.564254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf6f77-87be-4581-9ec0-ca2d2b143c17 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:18.564720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf6f77-87be-4581-9ec0-ca2d2b143c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:18.565198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf6f77-87be-4581-9ec0-ca2d2b143c17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:18.579617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fc588-b903-4b1a-ad7f-1472d95a56bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:18.581344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fc588-b903-4b1a-ad7f-1472d95a56bf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:18.595220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf6f77-87be-4581-9ec0-ca2d2b143c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-cfdf6f77-87be-4581-9ec0-ca2d2b143c17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:18.610154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:18.611169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:18.612045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a01fc588-b903-4b1a-ad7f-1472d95a56bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:18.613050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:18.613834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:18.614817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:18.614817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:18.614817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:18.614817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:18.614817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 357/726] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:18.615188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 370/727] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:18.622119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fc588-b903-4b1a-ad7f-1472d95a56bf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:18.622434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf6f77-87be-4581-9ec0-ca2d2b143c17 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:18.764316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf6f77-87be-4581-9ec0-ca2d2b143c17 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:18.806423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cabe1-08ff-4210-b882-d031b1cfd3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:18.807135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cabe1-08ff-4210-b882-d031b1cfd3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:18.807415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cabe1-08ff-4210-b882-d031b1cfd3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:18.807691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cabe1-08ff-4210-b882-d031b1cfd3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:18.808463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cabe1-08ff-4210-b882-d031b1cfd3d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:18.808797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cabe1-08ff-4210-b882-d031b1cfd3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:18.810430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cabe1-08ff-4210-b882-d031b1cfd3d8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:18.821435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 371/728] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:18.827286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cabe1-08ff-4210-b882-d031b1cfd3d8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:18.871276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:18.975337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cabe1-08ff-4210-b882-d031b1cfd3d8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:18.981149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fc588-b903-4b1a-ad7f-1472d95a56bf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:19.069652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d436232-482a-4eb9-aa90-af8bd3315144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:19.071360 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d436232-482a-4eb9-aa90-af8bd3315144 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:19.072233 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ded94-686b-4be2-949c-c0c2623700e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:19.073381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ded94-686b-4be2-949c-c0c2623700e1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:19.073995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ded94-686b-4be2-949c-c0c2623700e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:19.074497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ded94-686b-4be2-949c-c0c2623700e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:19.075714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d436232-482a-4eb9-aa90-af8bd3315144 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:19.076382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d436232-482a-4eb9-aa90-af8bd3315144 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:19.078808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d436232-482a-4eb9-aa90-af8bd3315144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:19.080197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d436232-482a-4eb9-aa90-af8bd3315144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:19.081854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d436232-482a-4eb9-aa90-af8bd3315144 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:19.102744 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ded94-686b-4be2-949c-c0c2623700e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:19.104688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ded94-686b-4be2-949c-c0c2623700e1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:19.109778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 358/729] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:19.122555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d436232-482a-4eb9-aa90-af8bd3315144 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-aa8ded94-686b-4be2-949c-c0c2623700e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:19.147503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:19.148483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:19.149474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:19.149474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:19.149474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:19.149474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:19.152280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 372/730] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:19.157805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ded94-686b-4be2-949c-c0c2623700e1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:19.182546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:19.386426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d436232-482a-4eb9-aa90-af8bd3315144 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:19.422953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:19.461462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ded94-686b-4be2-949c-c0c2623700e1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:19.574322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dd747-19c9-428e-9587-27510d88ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:19.575382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd747-19c9-428e-9587-27510d88ae4d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:19.575853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd747-19c9-428e-9587-27510d88ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:19.576321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd747-19c9-428e-9587-27510d88ae4d None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:19.577705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dd747-19c9-428e-9587-27510d88ae4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:19.578285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dd747-19c9-428e-9587-27510d88ae4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:19.580917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dd747-19c9-428e-9587-27510d88ae4d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:19.588138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d3668-df72-49f8-ab12-b8d5bdddff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:19.589974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3668-df72-49f8-ab12-b8d5bdddff91 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:19.590730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3668-df72-49f8-ab12-b8d5bdddff91 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:19.591489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3668-df72-49f8-ab12-b8d5bdddff91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:19.629096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d3668-df72-49f8-ab12-b8d5bdddff91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:19.632576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d3668-df72-49f8-ab12-b8d5bdddff91 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:19.645233 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 373/731] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:19.647686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dd747-19c9-428e-9587-27510d88ae4d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3b9d3668-df72-49f8-ab12-b8d5bdddff91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:19.682292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:19.683296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:19.684218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 359/732] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 566 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:19.693600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d3668-df72-49f8-ab12-b8d5bdddff91 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:19.938510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:19.973263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dd747-19c9-428e-9587-27510d88ae4d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:19.978120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d3668-df72-49f8-ab12-b8d5bdddff91 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:20.055801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4c5ed-b313-4638-b2f5-d17f11bb4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:20.056868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4c5ed-b313-4638-b2f5-d17f11bb4331 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:20.057339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4c5ed-b313-4638-b2f5-d17f11bb4331 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:20.057810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4c5ed-b313-4638-b2f5-d17f11bb4331 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:20.062437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb83e4-5fb1-4895-80b3-8de0e7d5bd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:20.063571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb83e4-5fb1-4895-80b3-8de0e7d5bd3b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:20.063860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb83e4-5fb1-4895-80b3-8de0e7d5bd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:20.064139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb83e4-5fb1-4895-80b3-8de0e7d5bd3b None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:20.065235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb83e4-5fb1-4895-80b3-8de0e7d5bd3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:20.065412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb83e4-5fb1-4895-80b3-8de0e7d5bd3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:20.066931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb83e4-5fb1-4895-80b3-8de0e7d5bd3b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:20.082673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4c5ed-b313-4638-b2f5-d17f11bb4331 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:20.084354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4c5ed-b313-4638-b2f5-d17f11bb4331 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:20.122171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 360/733] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 12:44:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-95b4c5ed-b313-4638-b2f5-d17f11bb4331 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:20.122876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:20.124042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:20.125128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:20.127626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 374/734] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:44:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 481 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:20.139147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb83e4-5fb1-4895-80b3-8de0e7d5bd3b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:20.140255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4c5ed-b313-4638-b2f5-d17f11bb4331 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:20.147596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:20.521491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4c5ed-b313-4638-b2f5-d17f11bb4331 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:20.575829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c8e0-75b2-4627-80cc-45e9cdc6b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:20.576787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c8e0-75b2-4627-80cc-45e9cdc6b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:20.576787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c8e0-75b2-4627-80cc-45e9cdc6b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:20.577055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c8e0-75b2-4627-80cc-45e9cdc6b4a2 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:20.578270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c8e0-75b2-4627-80cc-45e9cdc6b4a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:20.578761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c8e0-75b2-4627-80cc-45e9cdc6b4a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:20.581468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c8e0-75b2-4627-80cc-45e9cdc6b4a2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:20.608417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 375/735] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 12:44:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:20.610237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654f83-586a-42ab-8acc-6cb36ecd1697 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:20.610718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654f83-586a-42ab-8acc-6cb36ecd1697 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:20.611174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654f83-586a-42ab-8acc-6cb36ecd1697 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:20.618119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 376/736] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:20.619318 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27654f83-586a-42ab-8acc-6cb36ecd1697 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:20.621472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb83e4-5fb1-4895-80b3-8de0e7d5bd3b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:20.689526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a1d71-c6ea-4cde-9795-4a1280503535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:20.690993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1d71-c6ea-4cde-9795-4a1280503535 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:20.692041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1d71-c6ea-4cde-9795-4a1280503535 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:20.692865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1d71-c6ea-4cde-9795-4a1280503535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:20.705032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:20.716375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:20.776847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27654f83-586a-42ab-8acc-6cb36ecd1697 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:20.807464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a1d71-c6ea-4cde-9795-4a1280503535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:20.809117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a1d71-c6ea-4cde-9795-4a1280503535 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:20.837581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2eb62b-c125-427d-b6d8-21e3c1be67ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:20.838627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2eb62b-c125-427d-b6d8-21e3c1be67ae None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:20.839098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2eb62b-c125-427d-b6d8-21e3c1be67ae None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:20.839556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2eb62b-c125-427d-b6d8-21e3c1be67ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:20.958162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2eb62b-c125-427d-b6d8-21e3c1be67ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:20.960945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2eb62b-c125-427d-b6d8-21e3c1be67ae None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:20.961328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 361/737] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 823 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 12:44:20.963270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c42e5e-a062-4ed2-92c9-d6d14ab39c1b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:20.963828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c42e5e-a062-4ed2-92c9-d6d14ab39c1b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:20.964695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c42e5e-a062-4ed2-92c9-d6d14ab39c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:20.985951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c5c42e5e-a062-4ed2-92c9-d6d14ab39c1b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:20.987288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c5c42e5e-a062-4ed2-92c9-d6d14ab39c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:21.023583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:21.048196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:21.076841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 362/738] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:21.078947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce9ed5-9b78-4709-82f2-e0a4e60e746c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:21.079233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce9ed5-9b78-4709-82f2-e0a4e60e746c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:21.079506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce9ed5-9b78-4709-82f2-e0a4e60e746c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:21.080800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 363/739] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:21.081640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce9ed5-9b78-4709-82f2-e0a4e60e746c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:21.108450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 377/740] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 12:44:21.110107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76036e-d42a-4060-a19a-f3e4b7e90151 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:21.110556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76036e-d42a-4060-a19a-f3e4b7e90151 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:21.111004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76036e-d42a-4060-a19a-f3e4b7e90151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:21.130250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2c76036e-d42a-4060-a19a-f3e4b7e90151 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:21.132713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2c76036e-d42a-4060-a19a-f3e4b7e90151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:21.218060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce9ed5-9b78-4709-82f2-e0a4e60e746c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:21.243385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 378/741] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:21.245019 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76036e-d42a-4060-a19a-f3e4b7e90151 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:21.271805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd961b30-4efa-4b90-9c69-3583a31616f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:21.273219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd961b30-4efa-4b90-9c69-3583a31616f0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:21.273709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd961b30-4efa-4b90-9c69-3583a31616f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:21.274224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd961b30-4efa-4b90-9c69-3583a31616f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:21.294607 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd961b30-4efa-4b90-9c69-3583a31616f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:21.297373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd961b30-4efa-4b90-9c69-3583a31616f0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dd961b30-4efa-4b90-9c69-3583a31616f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:21.325780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:21.326828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:21.327718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:21.327718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:21.327718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:21.327718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:21.327943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 364/742] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:21.329339 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd961b30-4efa-4b90-9c69-3583a31616f0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:21.358778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:21.381618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:21.392064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76036e-d42a-4060-a19a-f3e4b7e90151 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:21.438257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01999ee-216f-4808-962f-f336ec050f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:21.439150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01999ee-216f-4808-962f-f336ec050f17 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:21.439433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01999ee-216f-4808-962f-f336ec050f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:21.440472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01999ee-216f-4808-962f-f336ec050f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:21.456407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01999ee-216f-4808-962f-f336ec050f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:21.458268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01999ee-216f-4808-962f-f336ec050f17 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d01999ee-216f-4808-962f-f336ec050f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:21.493324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:21.495145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:21.496982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:21.496982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:21.496982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:21.496982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:21.496982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 379/743] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:21.496982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01999ee-216f-4808-962f-f336ec050f17 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:21.511023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd961b30-4efa-4b90-9c69-3583a31616f0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:21.566645 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93fb88-4877-48a7-b258-f197dc1f47a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:21.567486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93fb88-4877-48a7-b258-f197dc1f47a5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:21.567814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93fb88-4877-48a7-b258-f197dc1f47a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:21.568213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93fb88-4877-48a7-b258-f197dc1f47a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:21.583377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93fb88-4877-48a7-b258-f197dc1f47a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ff93fb88-4877-48a7-b258-f197dc1f47a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:21.592461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:21.594697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 365/744] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:21.596333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93fb88-4877-48a7-b258-f197dc1f47a5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:21.663518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01999ee-216f-4808-962f-f336ec050f17 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:21.713626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:21.714741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2034-b8d2-4986-8a0f-08d8b997f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:21.715471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2034-b8d2-4986-8a0f-08d8b997f0df None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:21.715762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2034-b8d2-4986-8a0f-08d8b997f0df None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:21.716031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2034-b8d2-4986-8a0f-08d8b997f0df None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:21.716849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d2034-b8d2-4986-8a0f-08d8b997f0df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:21.718627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d2034-b8d2-4986-8a0f-08d8b997f0df None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:21.744117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93fb88-4877-48a7-b258-f197dc1f47a5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:21.744863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 380/745] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:44:21 2022] POST /identity/v3/services => generated 240 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:44:21.746458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2034-b8d2-4986-8a0f-08d8b997f0df None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:21.764008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:21.833768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979a8b-2364-4095-a6f9-2f946b817f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:21.834555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979a8b-2364-4095-a6f9-2f946b817f79 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:21.835061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979a8b-2364-4095-a6f9-2f946b817f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:21.835559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979a8b-2364-4095-a6f9-2f946b817f79 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:21.836793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979a8b-2364-4095-a6f9-2f946b817f79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:21.837274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979a8b-2364-4095-a6f9-2f946b817f79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:21.839657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a979a8b-2364-4095-a6f9-2f946b817f79 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:21.867237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 366/746] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:21.867237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fbe1f-ffca-48cd-87e9-d9b61932f6e4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:21.867237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fbe1f-ffca-48cd-87e9-d9b61932f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:21.867237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fbe1f-ffca-48cd-87e9-d9b61932f6e4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:21.867237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 367/747] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:21.868472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fbe1f-ffca-48cd-87e9-d9b61932f6e4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:21.955064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d2034-b8d2-4986-8a0f-08d8b997f0df None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:22.002197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc12ce-67c5-496e-a47e-c21af7f7f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:22.002890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc12ce-67c5-496e-a47e-c21af7f7f2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:22.003168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc12ce-67c5-496e-a47e-c21af7f7f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:22.003444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc12ce-67c5-496e-a47e-c21af7f7f2c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:22.004343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc12ce-67c5-496e-a47e-c21af7f7f2c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:22.004704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc12ce-67c5-496e-a47e-c21af7f7f2c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:22.006400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc12ce-67c5-496e-a47e-c21af7f7f2c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:22.020608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 381/748] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:22.021492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc12ce-67c5-496e-a47e-c21af7f7f2c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:22.052597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fbe1f-ffca-48cd-87e9-d9b61932f6e4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:22.120126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:22.121199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe60c0-ca1c-4cde-b63d-8f0f117c666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:22.122405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe60c0-ca1c-4cde-b63d-8f0f117c666d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:22.122907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe60c0-ca1c-4cde-b63d-8f0f117c666d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:22.123370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe60c0-ca1c-4cde-b63d-8f0f117c666d None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:22.124736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe60c0-ca1c-4cde-b63d-8f0f117c666d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:22.125013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe60c0-ca1c-4cde-b63d-8f0f117c666d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:22.127507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe60c0-ca1c-4cde-b63d-8f0f117c666d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:22.131809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:22.154241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 368/749] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:22.154241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4c45-b435-4e1b-9865-5df919977ea8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:22.154241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4c45-b435-4e1b-9865-5df919977ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:22.154241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4c45-b435-4e1b-9865-5df919977ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:22.176098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-916c4c45-b435-4e1b-9865-5df919977ea8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:22.178527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-916c4c45-b435-4e1b-9865-5df919977ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:22.212173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc12ce-67c5-496e-a47e-c21af7f7f2c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:22.276326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532bdd1-c572-4570-b0ad-48ed33aa6b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:22.278204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532bdd1-c572-4570-b0ad-48ed33aa6b8e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:22.278204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532bdd1-c572-4570-b0ad-48ed33aa6b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:22.278204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532bdd1-c572-4570-b0ad-48ed33aa6b8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:22.283436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 369/750] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:22 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 12:44:22.284680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4c45-b435-4e1b-9865-5df919977ea8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:22.299509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532bdd1-c572-4570-b0ad-48ed33aa6b8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:22.304699 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532bdd1-c572-4570-b0ad-48ed33aa6b8e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f532bdd1-c572-4570-b0ad-48ed33aa6b8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:22.333688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:22.335423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:22.337118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:22.337118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:22.337118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:22.337118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:22.337118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:22.337118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:22.337118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:22.337118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:22.343448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 382/751] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:22.345253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532bdd1-c572-4570-b0ad-48ed33aa6b8e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:22.486997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4c45-b435-4e1b-9865-5df919977ea8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:22.496421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532bdd1-c572-4570-b0ad-48ed33aa6b8e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:22.527589 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:22.539472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:22.546987 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9ebd5-da30-430e-997b-6c37e331c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:22.548744 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9ebd5-da30-430e-997b-6c37e331c705 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:22.549516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9ebd5-da30-430e-997b-6c37e331c705 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:22.549706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9ebd5-da30-430e-997b-6c37e331c705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:22.553757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6c026-95a2-413f-a1b9-62113af663d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:22.555260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6c026-95a2-413f-a1b9-62113af663d0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:22.555818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6c026-95a2-413f-a1b9-62113af663d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:22.556233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6c026-95a2-413f-a1b9-62113af663d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:22.570841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6c026-95a2-413f-a1b9-62113af663d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:22.572851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9ebd5-da30-430e-997b-6c37e331c705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:22.573648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6c026-95a2-413f-a1b9-62113af663d0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:22.575591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9ebd5-da30-430e-997b-6c37e331c705 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f6b6c026-95a2-413f-a1b9-62113af663d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:22.602978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:22.603978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:22.604909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:22.604909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:22.604909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:22.604909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:22.604909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:22.604909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:22.604909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:22.604909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:22.605955 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 370/752] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:22.607419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6c026-95a2-413f-a1b9-62113af663d0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-89f9ebd5-da30-430e-997b-6c37e331c705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:22.610568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:22.619088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:22.620682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:22.620682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:22.620682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:22.620682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:22.620682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 383/753] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:22.620682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9ebd5-da30-430e-997b-6c37e331c705 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:22.763797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9ebd5-da30-430e-997b-6c37e331c705 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:22.822481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6c026-95a2-413f-a1b9-62113af663d0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:22.829995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506df67e-6a5a-49bd-9e29-e44911cba824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:22.831116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506df67e-6a5a-49bd-9e29-e44911cba824 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:22.831571 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506df67e-6a5a-49bd-9e29-e44911cba824 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:22.832050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506df67e-6a5a-49bd-9e29-e44911cba824 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:22.833688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506df67e-6a5a-49bd-9e29-e44911cba824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:22.834255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506df67e-6a5a-49bd-9e29-e44911cba824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:22.837261 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506df67e-6a5a-49bd-9e29-e44911cba824 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:22.869083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 384/754] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:22.869083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506df67e-6a5a-49bd-9e29-e44911cba824 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:22.892028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20341060-2c1b-490b-bb40-79edbe9c38e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:22.893155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20341060-2c1b-490b-bb40-79edbe9c38e5 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:22.893649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20341060-2c1b-490b-bb40-79edbe9c38e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:22.894161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20341060-2c1b-490b-bb40-79edbe9c38e5 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:22.895502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20341060-2c1b-490b-bb40-79edbe9c38e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:22.898045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20341060-2c1b-490b-bb40-79edbe9c38e5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:22.942151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 371/755] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:44:22 2022] POST /identity/v3/services => generated 251 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:44:22.942151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20341060-2c1b-490b-bb40-79edbe9c38e5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:22.946440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:23.049256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:23.073701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506df67e-6a5a-49bd-9e29-e44911cba824 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:23.139317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b81c4-4a87-48c6-9068-fda75f910549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:23.140458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b81c4-4a87-48c6-9068-fda75f910549 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:23.140745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b81c4-4a87-48c6-9068-fda75f910549 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:23.141021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b81c4-4a87-48c6-9068-fda75f910549 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:23.141911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b81c4-4a87-48c6-9068-fda75f910549 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:23.142272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b81c4-4a87-48c6-9068-fda75f910549 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:23.144493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b81c4-4a87-48c6-9068-fda75f910549 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:23.148829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20341060-2c1b-490b-bb40-79edbe9c38e5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:23.167893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 385/756] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:23.169208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b81c4-4a87-48c6-9068-fda75f910549 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:23.204212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81011861-550a-4731-84df-d15d9e5d7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:23.205700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81011861-550a-4731-84df-d15d9e5d7cef None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:23.206241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81011861-550a-4731-84df-d15d9e5d7cef None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:23.206716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81011861-550a-4731-84df-d15d9e5d7cef None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:23.207500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81011861-550a-4731-84df-d15d9e5d7cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:23.207821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81011861-550a-4731-84df-d15d9e5d7cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:23.209826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81011861-550a-4731-84df-d15d9e5d7cef None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:23.228577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 372/757] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:23.229484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81011861-550a-4731-84df-d15d9e5d7cef None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:23.344761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:23.367804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b81c4-4a87-48c6-9068-fda75f910549 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:23.412911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81011861-550a-4731-84df-d15d9e5d7cef None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:23.425595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:23.453764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8602d04-7360-460d-84b4-b3197dff35fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:23.456818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602d04-7360-460d-84b4-b3197dff35fa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:23.457473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602d04-7360-460d-84b4-b3197dff35fa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:23.458573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602d04-7360-460d-84b4-b3197dff35fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:23.461087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8602d04-7360-460d-84b4-b3197dff35fa None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=ed5fff4bed294d16a0e1d5fec4991c58) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:23.462268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8602d04-7360-460d-84b4-b3197dff35fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:23.466478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8602d04-7360-460d-84b4-b3197dff35fa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:23.473261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c85e6-4333-4099-9073-ed7b5290692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:23.474628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c85e6-4333-4099-9073-ed7b5290692d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:23.475244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c85e6-4333-4099-9073-ed7b5290692d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:23.475864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c85e6-4333-4099-9073-ed7b5290692d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:23.477453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c85e6-4333-4099-9073-ed7b5290692d None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=3b34545615e447329344a942cd31c12a) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:23.478073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c85e6-4333-4099-9073-ed7b5290692d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:23.482147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c85e6-4333-4099-9073-ed7b5290692d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:23.486264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 386/758] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:23 2022] GET /identity/v3/role_assignments?user.id=ed5fff4bed294d16a0e1d5fec4991c58&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:23.489433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8602d04-7360-460d-84b4-b3197dff35fa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:23.501364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 373/759] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:23 2022] GET /identity/v3/role_assignments?user.id=3b34545615e447329344a942cd31c12a&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:23.670112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8602d04-7360-460d-84b4-b3197dff35fa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:23.722221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9272f2e-d119-4cc8-ae64-756bf2fd5db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:23.723083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9272f2e-d119-4cc8-ae64-756bf2fd5db2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:23.723371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9272f2e-d119-4cc8-ae64-756bf2fd5db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:23.723648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9272f2e-d119-4cc8-ae64-756bf2fd5db2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:23.741095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9272f2e-d119-4cc8-ae64-756bf2fd5db2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:23.742724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9272f2e-d119-4cc8-ae64-756bf2fd5db2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c9272f2e-d119-4cc8-ae64-756bf2fd5db2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:23.766735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:23.769171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:23.771880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 387/760] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 12:44:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:23.775895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c85e6-4333-4099-9073-ed7b5290692d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:23.966761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c85e6-4333-4099-9073-ed7b5290692d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:24.014358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d6c8-fea5-45e3-89f5-96facafd699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:24.015053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d6c8-fea5-45e3-89f5-96facafd699a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:24.015342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d6c8-fea5-45e3-89f5-96facafd699a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:24.015616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d6c8-fea5-45e3-89f5-96facafd699a None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:24.016453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39d6c8-fea5-45e3-89f5-96facafd699a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:24.016757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39d6c8-fea5-45e3-89f5-96facafd699a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:24.018241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39d6c8-fea5-45e3-89f5-96facafd699a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:24.054156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 374/761] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 12:44:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:24.063256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9272f2e-d119-4cc8-ae64-756bf2fd5db2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:24.098711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:24.238656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9272f2e-d119-4cc8-ae64-756bf2fd5db2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:24.290447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43c1d1-d319-4be3-a868-ac4def65056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:24.291303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43c1d1-d319-4be3-a868-ac4def65056b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:24.291590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43c1d1-d319-4be3-a868-ac4def65056b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:24.291869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43c1d1-d319-4be3-a868-ac4def65056b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:24.304776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43c1d1-d319-4be3-a868-ac4def65056b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:24.306349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43c1d1-d319-4be3-a868-ac4def65056b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-2a43c1d1-d319-4be3-a868-ac4def65056b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:24.344741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:24.345733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:24.346662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:24.346662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:24.346662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:24.346662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:24.346662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 388/762] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:24.353275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d6c8-fea5-45e3-89f5-96facafd699a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:24.420920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:24.535733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d6c8-fea5-45e3-89f5-96facafd699a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:24.586042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1d59-69ff-4010-8035-feac29f6a03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:24.586785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1d59-69ff-4010-8035-feac29f6a03b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:24.587189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1d59-69ff-4010-8035-feac29f6a03b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:24.587549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1d59-69ff-4010-8035-feac29f6a03b None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:24.588689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1d59-69ff-4010-8035-feac29f6a03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:24.589183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1d59-69ff-4010-8035-feac29f6a03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:24.591532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1d59-69ff-4010-8035-feac29f6a03b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:24.617398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 375/763] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:24.623209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43c1d1-d319-4be3-a868-ac4def65056b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:24.722737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:24.779384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43c1d1-d319-4be3-a868-ac4def65056b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:24.826259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12b84b-4702-4d8e-a36f-1bea0349cb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:24.827023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12b84b-4702-4d8e-a36f-1bea0349cb87 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:24.827307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12b84b-4702-4d8e-a36f-1bea0349cb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:24.827589 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12b84b-4702-4d8e-a36f-1bea0349cb87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:24.842756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12b84b-4702-4d8e-a36f-1bea0349cb87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:24.844486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12b84b-4702-4d8e-a36f-1bea0349cb87 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3e12b84b-4702-4d8e-a36f-1bea0349cb87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:24.873409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:24.875607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:24.878738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:24.878738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:24.878738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:24.878738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:24.878738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:24.878738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:24.878738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:24.878738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:24.878738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 389/764] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:24.883065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1d59-69ff-4010-8035-feac29f6a03b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:25.120453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:25.137083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1d59-69ff-4010-8035-feac29f6a03b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:25.196686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ffb3f-90c5-4c17-87a2-f38bc70607bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:25.197811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ffb3f-90c5-4c17-87a2-f38bc70607bb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:25.198321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ffb3f-90c5-4c17-87a2-f38bc70607bb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:25.198792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ffb3f-90c5-4c17-87a2-f38bc70607bb None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:25.200262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ffb3f-90c5-4c17-87a2-f38bc70607bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:25.201014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ffb3f-90c5-4c17-87a2-f38bc70607bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:25.203734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ffb3f-90c5-4c17-87a2-f38bc70607bb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:25.231897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 376/765] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:25.241836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12b84b-4702-4d8e-a36f-1bea0349cb87 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:25.424803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e2c5b-c423-414f-807b-fbd62bc7ac37 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:25.425325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e2c5b-c423-414f-807b-fbd62bc7ac37 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:25.425639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e2c5b-c423-414f-807b-fbd62bc7ac37 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:25.428724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 377/766] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:25.444560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a98c4-2166-4470-8380-d6f1a3d6eb8b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:25.445023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a98c4-2166-4470-8380-d6f1a3d6eb8b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:25.445134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12b84b-4702-4d8e-a36f-1bea0349cb87 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:25.445482 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a98c4-2166-4470-8380-d6f1a3d6eb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:25.478582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:25.486451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-544a98c4-2166-4470-8380-d6f1a3d6eb8b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:25.487984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-544a98c4-2166-4470-8380-d6f1a3d6eb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:25.491793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ca0cb-2620-468c-94f4-43935d686dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:25.492737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ca0cb-2620-468c-94f4-43935d686dbc None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:25.493016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ca0cb-2620-468c-94f4-43935d686dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:25.493289 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ca0cb-2620-468c-94f4-43935d686dbc None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/09a967d14a7243068a016b4677e47234/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:25.495382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ca0cb-2620-468c-94f4-43935d686dbc None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=09a967d14a7243068a016b4677e47234, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:25.496881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ca0cb-2620-468c-94f4-43935d686dbc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:25.522265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 390/767] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:44:25 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/09a967d14a7243068a016b4677e47234/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:44:25.608489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 378/768] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:25.655408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ca0cb-2620-468c-94f4-43935d686dbc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:25.780725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ca0cb-2620-468c-94f4-43935d686dbc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:25.824125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8df846-4bb0-469b-a9b5-ca0ef76fd0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:25.824983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8df846-4bb0-469b-a9b5-ca0ef76fd0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:25.825269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8df846-4bb0-469b-a9b5-ca0ef76fd0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:25.825544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8df846-4bb0-469b-a9b5-ca0ef76fd0b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:25.826315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8df846-4bb0-469b-a9b5-ca0ef76fd0b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:25.827667 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8df846-4bb0-469b-a9b5-ca0ef76fd0b5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6f8df846-4bb0-469b-a9b5-ca0ef76fd0b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:25.847447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:25.848555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 12:44:25.849577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:25.853943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 391/769] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:25 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:25.855547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a98c4-2166-4470-8380-d6f1a3d6eb8b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:25.966875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:25.991492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a98c4-2166-4470-8380-d6f1a3d6eb8b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:26.034256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6adb9-182b-4406-b4f8-4feb5553f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:26.034867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6adb9-182b-4406-b4f8-4feb5553f373 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.035203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6adb9-182b-4406-b4f8-4feb5553f373 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.035488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6adb9-182b-4406-b4f8-4feb5553f373 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.036312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6adb9-182b-4406-b4f8-4feb5553f373 None admin] RBAC: Adding query filter params (name=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:26.036672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6adb9-182b-4406-b4f8-4feb5553f373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:26.038047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6adb9-182b-4406-b4f8-4feb5553f373 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:26.043868 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 379/770] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:26.049843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8df846-4bb0-469b-a9b5-ca0ef76fd0b5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:26.129695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bb1b9-6014-4ff2-86be-aa7b73cd8d67 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.130140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bb1b9-6014-4ff2-86be-aa7b73cd8d67 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.130432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bb1b9-6014-4ff2-86be-aa7b73cd8d67 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.132133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 380/771] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:26.139216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:26.139563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b86898-b1bc-4529-bb88-1d32c20f612f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.139860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b86898-b1bc-4529-bb88-1d32c20f612f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.140137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b86898-b1bc-4529-bb88-1d32c20f612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.178120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-94b86898-b1bc-4529-bb88-1d32c20f612f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:26.178120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-94b86898-b1bc-4529-bb88-1d32c20f612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:26.194594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8df846-4bb0-469b-a9b5-ca0ef76fd0b5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:26.240507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2fadb-cbd2-4495-9191-2775ddffd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:26.241559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2fadb-cbd2-4495-9191-2775ddffd516 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.242020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2fadb-cbd2-4495-9191-2775ddffd516 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.242457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2fadb-cbd2-4495-9191-2775ddffd516 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.243328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2fadb-cbd2-4495-9191-2775ddffd516 None admin] RBAC: Adding query filter params (type=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:26.243782 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2fadb-cbd2-4495-9191-2775ddffd516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:26.245364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2fadb-cbd2-4495-9191-2775ddffd516 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:26.258780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 392/772] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:26.264922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2fadb-cbd2-4495-9191-2775ddffd516 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:26.314591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 381/773] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:26.355277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b86898-b1bc-4529-bb88-1d32c20f612f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:26.454958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2fadb-cbd2-4495-9191-2775ddffd516 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:26.498524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:26.500055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:26.531976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d6b82-0c8b-425f-b1c0-c6a0ec3cbaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:26.532683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d6b82-0c8b-425f-b1c0-c6a0ec3cbaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.532965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d6b82-0c8b-425f-b1c0-c6a0ec3cbaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.533237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d6b82-0c8b-425f-b1c0-c6a0ec3cbaa8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.535209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d6b82-0c8b-425f-b1c0-c6a0ec3cbaa8 None admin] RBAC: Adding query filter params (interface=public, service_id=82c92fb9c4b1462aa66f6c4beebfd27d, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:26.535530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d6b82-0c8b-425f-b1c0-c6a0ec3cbaa8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:26.537402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d6b82-0c8b-425f-b1c0-c6a0ec3cbaa8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:26.555212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 393/774] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 12:44:26 2022] GET /identity/v3/endpoints?service_id=82c92fb9c4b1462aa66f6c4beebfd27d&interface=public®ion_id=RegionOne => generated 194 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:26.557479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b86898-b1bc-4529-bb88-1d32c20f612f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:26.559548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d6b82-0c8b-425f-b1c0-c6a0ec3cbaa8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:26.646069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23d071-ccca-42a7-bee9-8364c4a5bc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:26.647011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23d071-ccca-42a7-bee9-8364c4a5bc10 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.647453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23d071-ccca-42a7-bee9-8364c4a5bc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.647896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23d071-ccca-42a7-bee9-8364c4a5bc10 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.648726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23d071-ccca-42a7-bee9-8364c4a5bc10 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:26.650404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23d071-ccca-42a7-bee9-8364c4a5bc10 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5d23d071-ccca-42a7-bee9-8364c4a5bc10 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:26.670078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:26.671285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 12:44:26.672261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:26.675236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 382/775] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Jun 17 12:44:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:26.676776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d8ab2-9bb2-4305-99d8-1b542aae8a31 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.677611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d8ab2-9bb2-4305-99d8-1b542aae8a31 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.678221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d8ab2-9bb2-4305-99d8-1b542aae8a31 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.679972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 383/776] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:26.682800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d8ab2-9bb2-4305-99d8-1b542aae8a31 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:26.712819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d6b82-0c8b-425f-b1c0-c6a0ec3cbaa8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:26.760188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c8acd-4990-4053-9745-10f73fcafc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:26.760883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8acd-4990-4053-9745-10f73fcafc7e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.761172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8acd-4990-4053-9745-10f73fcafc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.761612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8acd-4990-4053-9745-10f73fcafc7e None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.762285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c8acd-4990-4053-9745-10f73fcafc7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:26.763839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c8acd-4990-4053-9745-10f73fcafc7e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:26.770253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 394/777] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 12:44:26 2022] GET /identity/v3/services => generated 772 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:26.772481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8741a-8cc0-4aa6-b155-e03800bacafe None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.772772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8741a-8cc0-4aa6-b155-e03800bacafe None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.773081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8741a-8cc0-4aa6-b155-e03800bacafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.794259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f3e8741a-8cc0-4aa6-b155-e03800bacafe None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:26.795558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f3e8741a-8cc0-4aa6-b155-e03800bacafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:26.824268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d8ab2-9bb2-4305-99d8-1b542aae8a31 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:26.874567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:26.926885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e590-cdb9-4b7e-a2bd-534a5e33b4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:26.927647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e590-cdb9-4b7e-a2bd-534a5e33b4fc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.927926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e590-cdb9-4b7e-a2bd-534a5e33b4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.928372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e590-cdb9-4b7e-a2bd-534a5e33b4fc None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.929126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37e590-cdb9-4b7e-a2bd-534a5e33b4fc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:26.929434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37e590-cdb9-4b7e-a2bd-534a5e33b4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:26.930878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37e590-cdb9-4b7e-a2bd-534a5e33b4fc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:26.934837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 395/778] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:26.936528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd2110-bf36-48ff-a351-34a1c2cfd195 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.937097 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd2110-bf36-48ff-a351-34a1c2cfd195 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.937377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd2110-bf36-48ff-a351-34a1c2cfd195 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.938943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 396/780] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:26.943003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 384/780] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 12:44:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:26.947925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313da0a-cc16-4a55-a064-93f6ef246af8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:26.948299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313da0a-cc16-4a55-a064-93f6ef246af8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:26.948578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313da0a-cc16-4a55-a064-93f6ef246af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:26.950558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e590-cdb9-4b7e-a2bd-534a5e33b4fc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:26.954443 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:26.977323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9313da0a-cc16-4a55-a064-93f6ef246af8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:26.979151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9313da0a-cc16-4a55-a064-93f6ef246af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:27.065693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 397/781] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:27.067003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313da0a-cc16-4a55-a064-93f6ef246af8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:27.107788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e590-cdb9-4b7e-a2bd-534a5e33b4fc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:27.146747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2e402-6201-493c-932b-edace0064250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:27.147677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e402-6201-493c-932b-edace0064250 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:27.147998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e402-6201-493c-932b-edace0064250 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:27.148285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e402-6201-493c-932b-edace0064250 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:27.149439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2e402-6201-493c-932b-edace0064250 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:27.149780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2e402-6201-493c-932b-edace0064250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:27.151304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2e402-6201-493c-932b-edace0064250 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:27.162186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 385/782] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 12:44:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:27.163623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2e402-6201-493c-932b-edace0064250 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:27.223035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313da0a-cc16-4a55-a064-93f6ef246af8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:27.250833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:27.258514 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:27.268910 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fae9e-c01f-465b-b220-6b0dac56a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:27.270570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fae9e-c01f-465b-b220-6b0dac56a108 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:27.271346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fae9e-c01f-465b-b220-6b0dac56a108 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:27.271844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fae9e-c01f-465b-b220-6b0dac56a108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:27.287322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fae9e-c01f-465b-b220-6b0dac56a108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:27.295030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2e402-6201-493c-932b-edace0064250 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a74fae9e-c01f-465b-b220-6b0dac56a108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:27.299680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:27.300644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:27.301489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:27.304743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 398/783] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:27.305958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fae9e-c01f-465b-b220-6b0dac56a108 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:27.347308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc4bd9-c4b0-435f-825c-4eed0b356ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:27.348137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4bd9-c4b0-435f-825c-4eed0b356ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:27.348492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4bd9-c4b0-435f-825c-4eed0b356ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:27.349076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4bd9-c4b0-435f-825c-4eed0b356ad3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:27.363235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc4bd9-c4b0-435f-825c-4eed0b356ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-52bc4bd9-c4b0-435f-825c-4eed0b356ad3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:27.372099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:27.373293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:27.374173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:27.378831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 386/784] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:27.379781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc4bd9-c4b0-435f-825c-4eed0b356ad3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:27.455429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fae9e-c01f-465b-b220-6b0dac56a108 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:27.506651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc4bd9-c4b0-435f-825c-4eed0b356ad3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:27.515908 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14001a66-8619-4ae6-9829-7637f18432f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:27.517351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14001a66-8619-4ae6-9829-7637f18432f4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:27.517839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14001a66-8619-4ae6-9829-7637f18432f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:27.518741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14001a66-8619-4ae6-9829-7637f18432f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:27.520064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14001a66-8619-4ae6-9829-7637f18432f4 None admin] RBAC: Adding query filter params (interface=public, service_id=df65b82d5df749c19d83fa8a08a180c3, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:27.520623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14001a66-8619-4ae6-9829-7637f18432f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:27.523300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14001a66-8619-4ae6-9829-7637f18432f4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:27.531461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 399/785] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 12:44:27 2022] GET /identity/v3/endpoints?service_id=df65b82d5df749c19d83fa8a08a180c3&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:27.533431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14001a66-8619-4ae6-9829-7637f18432f4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:27.538457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:27.549469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318d31-d7ce-4bf6-bd9a-872246fc1dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:27.550885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318d31-d7ce-4bf6-bd9a-872246fc1dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:27.551620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318d31-d7ce-4bf6-bd9a-872246fc1dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:27.552820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38318d31-d7ce-4bf6-bd9a-872246fc1dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:27.554319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38318d31-d7ce-4bf6-bd9a-872246fc1dc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:27.555033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38318d31-d7ce-4bf6-bd9a-872246fc1dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:27.556855 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38318d31-d7ce-4bf6-bd9a-872246fc1dc5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:27.567278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 387/786] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:27.568808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318d31-d7ce-4bf6-bd9a-872246fc1dc5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:27.574434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:27.654703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14001a66-8619-4ae6-9829-7637f18432f4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:27.684013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38318d31-d7ce-4bf6-bd9a-872246fc1dc5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:27.691221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d55e-77a5-4144-ac3b-16362e087dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:27.692158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d55e-77a5-4144-ac3b-16362e087dfc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:27.692686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d55e-77a5-4144-ac3b-16362e087dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:27.693177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8d55e-77a5-4144-ac3b-16362e087dfc None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:27.694184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d55e-77a5-4144-ac3b-16362e087dfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:27.694705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d55e-77a5-4144-ac3b-16362e087dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:27.696337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8d55e-77a5-4144-ac3b-16362e087dfc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:27.705814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 400/787] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:27.707045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d55e-77a5-4144-ac3b-16362e087dfc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:27.727831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772627d0-7ea9-45b2-b2e6-727ce7afa793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:27.728531 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772627d0-7ea9-45b2-b2e6-727ce7afa793 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:27.728793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772627d0-7ea9-45b2-b2e6-727ce7afa793 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:27.729069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772627d0-7ea9-45b2-b2e6-727ce7afa793 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:27.729847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772627d0-7ea9-45b2-b2e6-727ce7afa793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:27.731389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772627d0-7ea9-45b2-b2e6-727ce7afa793 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:27.746319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 388/788] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 12:44:27 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:27.746319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772627d0-7ea9-45b2-b2e6-727ce7afa793 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:27.804684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:27.883936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:27.898778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772627d0-7ea9-45b2-b2e6-727ce7afa793 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:27.904512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8d55e-77a5-4144-ac3b-16362e087dfc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:27.977382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94e0a4-ecc9-44c1-878b-68f2d85c513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:27.978402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94e0a4-ecc9-44c1-878b-68f2d85c513c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:27.978686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94e0a4-ecc9-44c1-878b-68f2d85c513c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:27.978958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94e0a4-ecc9-44c1-878b-68f2d85c513c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:27.988880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925dc3b-fb84-459c-8475-931e5d4f3754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:27.993184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925dc3b-fb84-459c-8475-931e5d4f3754 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:27.993184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925dc3b-fb84-459c-8475-931e5d4f3754 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:27.993184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925dc3b-fb84-459c-8475-931e5d4f3754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:27.997755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94e0a4-ecc9-44c1-878b-68f2d85c513c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:27.999282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94e0a4-ecc9-44c1-878b-68f2d85c513c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.010067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925dc3b-fb84-459c-8475-931e5d4f3754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:28.012042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925dc3b-fb84-459c-8475-931e5d4f3754 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dd94e0a4-ecc9-44c1-878b-68f2d85c513c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:28.018966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:28.019897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:28.020852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:28.020852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:28.020852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:28.020852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:28.020852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 389/789] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:28.026545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94e0a4-ecc9-44c1-878b-68f2d85c513c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8925dc3b-fb84-459c-8475-931e5d4f3754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:28.037682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:28.039479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:28.040370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:28.040370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:28.040370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:28.040370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:28.042828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 401/790] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:28.048961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925dc3b-fb84-459c-8475-931e5d4f3754 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:28.142263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94e0a4-ecc9-44c1-878b-68f2d85c513c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:28.145294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:28.169142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925dc3b-fb84-459c-8475-931e5d4f3754 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:28.183642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aa80e-4856-48ed-b1b1-585da873db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:28.184452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aa80e-4856-48ed-b1b1-585da873db24 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.184657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aa80e-4856-48ed-b1b1-585da873db24 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.184893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aa80e-4856-48ed-b1b1-585da873db24 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.185710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aa80e-4856-48ed-b1b1-585da873db24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:28.186043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aa80e-4856-48ed-b1b1-585da873db24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:28.188598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aa80e-4856-48ed-b1b1-585da873db24 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.202790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 390/791] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:28.209008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aa80e-4856-48ed-b1b1-585da873db24 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:28.218868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238cde5-9246-4a2a-866f-08f5cf0022b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:28.220077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238cde5-9246-4a2a-866f-08f5cf0022b5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.220591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238cde5-9246-4a2a-866f-08f5cf0022b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.221070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238cde5-9246-4a2a-866f-08f5cf0022b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.222186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238cde5-9246-4a2a-866f-08f5cf0022b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:28.222713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238cde5-9246-4a2a-866f-08f5cf0022b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:28.224546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238cde5-9246-4a2a-866f-08f5cf0022b5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.239713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 402/792] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:28.245618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238cde5-9246-4a2a-866f-08f5cf0022b5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:28.248839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:28.358475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238cde5-9246-4a2a-866f-08f5cf0022b5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:28.367968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aa80e-4856-48ed-b1b1-585da873db24 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:28.410879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde00df1-e7dc-4adc-8081-b0294a7c7722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:28.411664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde00df1-e7dc-4adc-8081-b0294a7c7722 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.411952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde00df1-e7dc-4adc-8081-b0294a7c7722 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.412234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde00df1-e7dc-4adc-8081-b0294a7c7722 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.412936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aa2bc-92d3-423f-aa93-fa0d8ceb6bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:28.413911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa2bc-92d3-423f-aa93-fa0d8ceb6bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.414386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa2bc-92d3-423f-aa93-fa0d8ceb6bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.414760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa2bc-92d3-423f-aa93-fa0d8ceb6bb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.421883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde00df1-e7dc-4adc-8081-b0294a7c7722 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:28.422906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aa2bc-92d3-423f-aa93-fa0d8ceb6bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:28.423836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde00df1-e7dc-4adc-8081-b0294a7c7722 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.424599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aa2bc-92d3-423f-aa93-fa0d8ceb6bb0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a10aa2bc-92d3-423f-aa93-fa0d8ceb6bb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:28.442926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:28.443982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:28.444945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-cde00df1-e7dc-4adc-8081-b0294a7c7722 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:28.446615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:28.447528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:28.448806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:28.450861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 391/794] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:28.452536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7234-e609-43a2-903c-5d8804c31403 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.453154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7234-e609-43a2-903c-5d8804c31403 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.453716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 403/794] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:28.454061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7234-e609-43a2-903c-5d8804c31403 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.454976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde00df1-e7dc-4adc-8081-b0294a7c7722 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:28.460914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 392/795] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:28.462232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e7234-e609-43a2-903c-5d8804c31403 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:28.491163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:28.526796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:28.571005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde00df1-e7dc-4adc-8081-b0294a7c7722 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:28.594970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e7234-e609-43a2-903c-5d8804c31403 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:28.611509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2a6fb-0406-4c5d-bedc-b860450dbaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:28.612318 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2a6fb-0406-4c5d-bedc-b860450dbaad None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.613266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2a6fb-0406-4c5d-bedc-b860450dbaad None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.613460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2a6fb-0406-4c5d-bedc-b860450dbaad None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.614647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2a6fb-0406-4c5d-bedc-b860450dbaad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:28.615334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2a6fb-0406-4c5d-bedc-b860450dbaad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:28.616958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2a6fb-0406-4c5d-bedc-b860450dbaad None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.642639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32a0f-f75f-4a5f-b788-db8d17290781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:28.643274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 404/796] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:28.644511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32a0f-f75f-4a5f-b788-db8d17290781 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.644945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a662a-19d6-463f-87a9-06025b6cc1dc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.645200 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32a0f-f75f-4a5f-b788-db8d17290781 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.645321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a662a-19d6-463f-87a9-06025b6cc1dc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.645675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a662a-19d6-463f-87a9-06025b6cc1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.645983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32a0f-f75f-4a5f-b788-db8d17290781 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.647066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba32a0f-f75f-4a5f-b788-db8d17290781 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:28.647560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba32a0f-f75f-4a5f-b788-db8d17290781 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:28.649399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba32a0f-f75f-4a5f-b788-db8d17290781 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.665698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e65a662a-19d6-463f-87a9-06025b6cc1dc None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:28.666918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e65a662a-19d6-463f-87a9-06025b6cc1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:28.672572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 393/797] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:28.673877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32a0f-f75f-4a5f-b788-db8d17290781 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:28.750117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 405/798] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:28.750117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a662a-19d6-463f-87a9-06025b6cc1dc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:28.804375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:28.817789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:28.830566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32a0f-f75f-4a5f-b788-db8d17290781 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:28.878547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a662a-19d6-463f-87a9-06025b6cc1dc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:28.881082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd28099-f14e-4b2f-8de3-53862703db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:28.882001 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd28099-f14e-4b2f-8de3-53862703db12 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.883333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd28099-f14e-4b2f-8de3-53862703db12 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.883693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd28099-f14e-4b2f-8de3-53862703db12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.898434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd28099-f14e-4b2f-8de3-53862703db12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:28.900952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd28099-f14e-4b2f-8de3-53862703db12 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.922201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b9462-bd78-4192-ba78-3bf422f6497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:28.923672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b9462-bd78-4192-ba78-3bf422f6497e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:28.924125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b9462-bd78-4192-ba78-3bf422f6497e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:28.924583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b9462-bd78-4192-ba78-3bf422f6497e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-bdd28099-f14e-4b2f-8de3-53862703db12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:28.925196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:28.926042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:28.927441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:28.927441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:28.927441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:28.927441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:28.930179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 394/799] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:28.931425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd28099-f14e-4b2f-8de3-53862703db12 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:28.947865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b9462-bd78-4192-ba78-3bf422f6497e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:28.949867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b9462-bd78-4192-ba78-3bf422f6497e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-762b9462-bd78-4192-ba78-3bf422f6497e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:28.976058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:28.977055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:28.978349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:28.978349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:28.978349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:28.978349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:28.978349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 406/800] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:28.978978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b9462-bd78-4192-ba78-3bf422f6497e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:29.049667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd28099-f14e-4b2f-8de3-53862703db12 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:29.093774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7aabf-6996-4257-8134-51bf07d95af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:29.095115 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7aabf-6996-4257-8134-51bf07d95af9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.095420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7aabf-6996-4257-8134-51bf07d95af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.095700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7aabf-6996-4257-8134-51bf07d95af9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.098174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:29.112602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7aabf-6996-4257-8134-51bf07d95af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:29.118002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b9462-bd78-4192-ba78-3bf422f6497e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:29.120124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-40d7aabf-6996-4257-8134-51bf07d95af9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:29.121870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:29.123078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:29.123982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 395/801] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:29.124680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7aabf-6996-4257-8134-51bf07d95af9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:29.169479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4a132-77a5-4950-a513-e905a6724a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:29.170476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a132-77a5-4950-a513-e905a6724a1b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.170769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a132-77a5-4950-a513-e905a6724a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.171045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4a132-77a5-4950-a513-e905a6724a1b None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.171942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4a132-77a5-4950-a513-e905a6724a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:29.172293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4a132-77a5-4950-a513-e905a6724a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:29.174368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4a132-77a5-4950-a513-e905a6724a1b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:29.190953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 407/802] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:29.192311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8c9d3-c8f9-4835-b268-ff4310abb30f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.192651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8c9d3-c8f9-4835-b268-ff4310abb30f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.192939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8c9d3-c8f9-4835-b268-ff4310abb30f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.198137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 408/803] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:29.198137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8c9d3-c8f9-4835-b268-ff4310abb30f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:29.241278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7aabf-6996-4257-8134-51bf07d95af9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:29.276559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6965a6-b83f-46fc-9430-c9bf28cce70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:29.277242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6965a6-b83f-46fc-9430-c9bf28cce70d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.277519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6965a6-b83f-46fc-9430-c9bf28cce70d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.277800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6965a6-b83f-46fc-9430-c9bf28cce70d None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.278563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6965a6-b83f-46fc-9430-c9bf28cce70d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:29.278872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6965a6-b83f-46fc-9430-c9bf28cce70d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:29.280294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6965a6-b83f-46fc-9430-c9bf28cce70d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:29.298404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 396/804] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:29.298404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6965a6-b83f-46fc-9430-c9bf28cce70d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:29.328773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8c9d3-c8f9-4835-b268-ff4310abb30f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:29.383163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:29.392168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f84b32-2d8d-427e-9f5b-b432bc0578f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:29.392997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84b32-2d8d-427e-9f5b-b432bc0578f1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.393357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84b32-2d8d-427e-9f5b-b432bc0578f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.393709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84b32-2d8d-427e-9f5b-b432bc0578f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.394634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f84b32-2d8d-427e-9f5b-b432bc0578f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:29.395106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f84b32-2d8d-427e-9f5b-b432bc0578f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:29.396884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f84b32-2d8d-427e-9f5b-b432bc0578f1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:29.422057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 409/805] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:29.422057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def166cc-94b2-4fe9-81a1-7b2557489f1b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.422057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def166cc-94b2-4fe9-81a1-7b2557489f1b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.422057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def166cc-94b2-4fe9-81a1-7b2557489f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.439493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-def166cc-94b2-4fe9-81a1-7b2557489f1b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:29.440659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-def166cc-94b2-4fe9-81a1-7b2557489f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:29.442663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6965a6-b83f-46fc-9430-c9bf28cce70d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:29.464337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:29.483196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b24637-b8ab-4ee9-9a6c-e1903c0d6729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:29.484238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24637-b8ab-4ee9-9a6c-e1903c0d6729 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.484557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24637-b8ab-4ee9-9a6c-e1903c0d6729 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.484893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b24637-b8ab-4ee9-9a6c-e1903c0d6729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.493455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b24637-b8ab-4ee9-9a6c-e1903c0d6729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:29.494987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b24637-b8ab-4ee9-9a6c-e1903c0d6729 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-22b24637-b8ab-4ee9-9a6c-e1903c0d6729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:29.513415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:29.514489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:29.515544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:29.515544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:29.515544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:29.515544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:29.515544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:29.515544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:29.515544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:29.515544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:29.515544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 397/806] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:29.516134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b24637-b8ab-4ee9-9a6c-e1903c0d6729 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:29.544006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 410/807] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:29.544973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def166cc-94b2-4fe9-81a1-7b2557489f1b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:29.659379 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b24637-b8ab-4ee9-9a6c-e1903c0d6729 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:29.666576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def166cc-94b2-4fe9-81a1-7b2557489f1b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:29.676874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:29.703485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59755158-7b04-486d-a380-0f7705541fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:29.703784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4532f-c7a2-4160-809e-ce59e6395a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:29.704327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59755158-7b04-486d-a380-0f7705541fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.704568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4532f-c7a2-4160-809e-ce59e6395a79 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.704686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59755158-7b04-486d-a380-0f7705541fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.704857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4532f-c7a2-4160-809e-ce59e6395a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.704960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59755158-7b04-486d-a380-0f7705541fc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.705120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4532f-c7a2-4160-809e-ce59e6395a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.712994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59755158-7b04-486d-a380-0f7705541fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:29.714536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59755158-7b04-486d-a380-0f7705541fc0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:29.717455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4532f-c7a2-4160-809e-ce59e6395a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:29.719163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4532f-c7a2-4160-809e-ce59e6395a79 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-59755158-7b04-486d-a380-0f7705541fc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:29.730658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:29.731814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:29.732690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:29.732690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:29.732690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:29.732690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:29.732690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:29.732690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:29.732690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:29.732690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:29.732690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 398/808] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:29.733430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59755158-7b04-486d-a380-0f7705541fc0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1fa4532f-c7a2-4160-809e-ce59e6395a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:29.746842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:29.747861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:29.748764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:29.748764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:29.748764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:29.748764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:29.753403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 411/809] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:29.754071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4532f-c7a2-4160-809e-ce59e6395a79 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:29.764120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:29.857087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59755158-7b04-486d-a380-0f7705541fc0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:29.903283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7b8bd-55a7-45a4-9743-d5a581c5eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:29.904021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7b8bd-55a7-45a4-9743-d5a581c5eaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:29.904298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7b8bd-55a7-45a4-9743-d5a581c5eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:29.904568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7b8bd-55a7-45a4-9743-d5a581c5eaa9 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:29.905390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7b8bd-55a7-45a4-9743-d5a581c5eaa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:29.905860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7b8bd-55a7-45a4-9743-d5a581c5eaa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:29.907255 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7b8bd-55a7-45a4-9743-d5a581c5eaa9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:29.927444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 399/810] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:29.927444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7b8bd-55a7-45a4-9743-d5a581c5eaa9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:29.988587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:30.011344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4532f-c7a2-4160-809e-ce59e6395a79 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:30.054418 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0617bfc-f6a3-41ed-9826-91bc4baca70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:30.055322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617bfc-f6a3-41ed-9826-91bc4baca70f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.055658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617bfc-f6a3-41ed-9826-91bc4baca70f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.056007 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0617bfc-f6a3-41ed-9826-91bc4baca70f None admin] PATH_INFO: `/v3/services/network` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.056687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0617bfc-f6a3-41ed-9826-91bc4baca70f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:30.058219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0617bfc-f6a3-41ed-9826-91bc4baca70f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f0617bfc-f6a3-41ed-9826-91bc4baca70f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:30.073312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:30.074543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 12:44:30.075746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:30.080222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 412/811] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:29 2022] GET /identity/v3/services/network => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:30.081289 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0617bfc-f6a3-41ed-9826-91bc4baca70f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:30.103189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7b8bd-55a7-45a4-9743-d5a581c5eaa9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:30.169275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:30.169653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade87f-b047-44d8-a128-7d01e2b30977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:30.170983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade87f-b047-44d8-a128-7d01e2b30977 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.171312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade87f-b047-44d8-a128-7d01e2b30977 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.171791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade87f-b047-44d8-a128-7d01e2b30977 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.173521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade87f-b047-44d8-a128-7d01e2b30977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:30.174039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade87f-b047-44d8-a128-7d01e2b30977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:30.176763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade87f-b047-44d8-a128-7d01e2b30977 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:30.198389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 400/812] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:30.199899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade87f-b047-44d8-a128-7d01e2b30977 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:30.212898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0617bfc-f6a3-41ed-9826-91bc4baca70f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:30.254207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de4c07-4327-4780-8b7f-7f8a94469716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:30.255550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4c07-4327-4780-8b7f-7f8a94469716 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.257279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4c07-4327-4780-8b7f-7f8a94469716 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.257775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de4c07-4327-4780-8b7f-7f8a94469716 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.259184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de4c07-4327-4780-8b7f-7f8a94469716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:30.259729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de4c07-4327-4780-8b7f-7f8a94469716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:30.262951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de4c07-4327-4780-8b7f-7f8a94469716 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:30.291746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 413/813] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:30.291746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de4c07-4327-4780-8b7f-7f8a94469716 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:30.327543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:30.336164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade87f-b047-44d8-a128-7d01e2b30977 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:30.375438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b23c2-fc0d-4bcb-b862-c0c6d8cb7c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:30.376391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b23c2-fc0d-4bcb-b862-c0c6d8cb7c95 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.376682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b23c2-fc0d-4bcb-b862-c0c6d8cb7c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.376965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b23c2-fc0d-4bcb-b862-c0c6d8cb7c95 None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/ed5fff4bed294d16a0e1d5fec4991c58/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.379176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b23c2-fc0d-4bcb-b862-c0c6d8cb7c95 None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=ed5fff4bed294d16a0e1d5fec4991c58, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:30.380735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b23c2-fc0d-4bcb-b862-c0c6d8cb7c95 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:30.401260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 401/814] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:44:30 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/ed5fff4bed294d16a0e1d5fec4991c58/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:44:30.401848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b23c2-fc0d-4bcb-b862-c0c6d8cb7c95 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:30.423027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de4c07-4327-4780-8b7f-7f8a94469716 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:30.471906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:30.482805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd267e15-c105-4e04-ac35-7969616f23df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:30.483827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd267e15-c105-4e04-ac35-7969616f23df None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.484272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd267e15-c105-4e04-ac35-7969616f23df None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.484728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd267e15-c105-4e04-ac35-7969616f23df None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.486357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd267e15-c105-4e04-ac35-7969616f23df None admin] RBAC: Adding query filter params (name=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:30.486721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd267e15-c105-4e04-ac35-7969616f23df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:30.488873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd267e15-c105-4e04-ac35-7969616f23df None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:30.500962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 414/815] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:30.500962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd267e15-c105-4e04-ac35-7969616f23df None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:30.566500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b23c2-fc0d-4bcb-b862-c0c6d8cb7c95 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:30.627894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dc318-a98b-4c51-b059-4a62e44381e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:30.628201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd267e15-c105-4e04-ac35-7969616f23df None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:30.628818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dc318-a98b-4c51-b059-4a62e44381e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.629093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dc318-a98b-4c51-b059-4a62e44381e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.629368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dc318-a98b-4c51-b059-4a62e44381e1 None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/3b34545615e447329344a942cd31c12a/roles/b90ffd0563104828953ba36cc5447825` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.647580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dc318-a98b-4c51-b059-4a62e44381e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=3b34545615e447329344a942cd31c12a, role_id=b90ffd0563104828953ba36cc5447825)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:30.649060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dc318-a98b-4c51-b059-4a62e44381e1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:30.664526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97121446-83a7-48ea-86bd-ceb7afc13911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:30.665536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 402/816] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:44:30 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/3b34545615e447329344a942cd31c12a/roles/b90ffd0563104828953ba36cc5447825 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:44:30.665988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97121446-83a7-48ea-86bd-ceb7afc13911 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.665988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97121446-83a7-48ea-86bd-ceb7afc13911 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.665988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97121446-83a7-48ea-86bd-ceb7afc13911 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.670556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dc318-a98b-4c51-b059-4a62e44381e1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:30.674833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:30.680344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97121446-83a7-48ea-86bd-ceb7afc13911 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:30.682275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97121446-83a7-48ea-86bd-ceb7afc13911 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-97121446-83a7-48ea-86bd-ceb7afc13911 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:30.698845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:30.699907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:30.700927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 415/817] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 12:44:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:30.701804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218a161-f367-45d1-b94b-ec8081ea3909 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.702114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218a161-f367-45d1-b94b-ec8081ea3909 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.702471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218a161-f367-45d1-b94b-ec8081ea3909 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.704000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 416/818] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:30.709473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218a161-f367-45d1-b94b-ec8081ea3909 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:30.779423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:30.805350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dc318-a98b-4c51-b059-4a62e44381e1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:30.842233 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218a161-f367-45d1-b94b-ec8081ea3909 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:30.862375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcd3a6-6060-429d-8433-be1100d57c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:30.862375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcd3a6-6060-429d-8433-be1100d57c22 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.862375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcd3a6-6060-429d-8433-be1100d57c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.862375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcd3a6-6060-429d-8433-be1100d57c22 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.863237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcd3a6-6060-429d-8433-be1100d57c22 None admin] RBAC: Adding query filter params (type=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:30.863237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcd3a6-6060-429d-8433-be1100d57c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:30.863237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcd3a6-6060-429d-8433-be1100d57c22 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:30.867817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 403/819] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:30.869350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d4f58-8467-4369-b93c-b6d510c201f7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.869699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d4f58-8467-4369-b93c-b6d510c201f7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.870037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d4f58-8467-4369-b93c-b6d510c201f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.891821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-567d4f58-8467-4369-b93c-b6d510c201f7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:30.892060 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9500fe-7644-4424-b5f5-47cd9ac12b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:30.892788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9500fe-7644-4424-b5f5-47cd9ac12b93 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:30.893074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9500fe-7644-4424-b5f5-47cd9ac12b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:30.893344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9500fe-7644-4424-b5f5-47cd9ac12b93 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:30.893495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-567d4f58-8467-4369-b93c-b6d510c201f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:30.894488 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9500fe-7644-4424-b5f5-47cd9ac12b93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:30.894928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9500fe-7644-4424-b5f5-47cd9ac12b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:30.896839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9500fe-7644-4424-b5f5-47cd9ac12b93 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:30.926762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 417/820] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 12:44:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:30.927608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9500fe-7644-4424-b5f5-47cd9ac12b93 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:30.974326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:30.983158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 404/821] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:30.984035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d4f58-8467-4369-b93c-b6d510c201f7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:31.050549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9500fe-7644-4424-b5f5-47cd9ac12b93 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:31.064934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:31.089988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65514b-8cac-4f14-bba5-6fcc670b164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:31.090861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65514b-8cac-4f14-bba5-6fcc670b164e None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:31.091262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65514b-8cac-4f14-bba5-6fcc670b164e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:31.091634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65514b-8cac-4f14-bba5-6fcc670b164e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:31.092513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65514b-8cac-4f14-bba5-6fcc670b164e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:31.093956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65514b-8cac-4f14-bba5-6fcc670b164e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:31.121148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d4f58-8467-4369-b93c-b6d510c201f7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:31.121755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 418/822] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 12:44:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:44:31.122692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65514b-8cac-4f14-bba5-6fcc670b164e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:31.216872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650fd61-6ba5-44a7-9a79-a25f59f6a82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:31.218852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650fd61-6ba5-44a7-9a79-a25f59f6a82d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:31.219149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650fd61-6ba5-44a7-9a79-a25f59f6a82d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:31.219430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650fd61-6ba5-44a7-9a79-a25f59f6a82d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:31.312569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65514b-8cac-4f14-bba5-6fcc670b164e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:31.324041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:31.347429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650fd61-6ba5-44a7-9a79-a25f59f6a82d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:31.349019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650fd61-6ba5-44a7-9a79-a25f59f6a82d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:31.363277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec0d50-3261-491a-bed7-b3eafb138e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:31.364135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec0d50-3261-491a-bed7-b3eafb138e5d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:31.364498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec0d50-3261-491a-bed7-b3eafb138e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:31.364776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec0d50-3261-491a-bed7-b3eafb138e5d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:31.365555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec0d50-3261-491a-bed7-b3eafb138e5d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:31.367082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec0d50-3261-491a-bed7-b3eafb138e5d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-82ec0d50-3261-491a-bed7-b3eafb138e5d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:31.381112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:31.383262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:31.384363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 419/823] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Jun 17 12:44:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:31.394804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec0d50-3261-491a-bed7-b3eafb138e5d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:31.449918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:31.513456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 405/824] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:31.523206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650fd61-6ba5-44a7-9a79-a25f59f6a82d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:31.544756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec0d50-3261-491a-bed7-b3eafb138e5d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:31.593082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f4123-14b7-4a54-aa9b-7987f7f412fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:31.594356 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4123-14b7-4a54-aa9b-7987f7f412fc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:31.594769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4123-14b7-4a54-aa9b-7987f7f412fc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:31.595166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f4123-14b7-4a54-aa9b-7987f7f412fc None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:31.596557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f4123-14b7-4a54-aa9b-7987f7f412fc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:31.597034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f4123-14b7-4a54-aa9b-7987f7f412fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:31.599374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f4123-14b7-4a54-aa9b-7987f7f412fc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:31.606776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 420/825] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 12:44:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:31.612532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f4123-14b7-4a54-aa9b-7987f7f412fc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:31.650050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:31.662875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650fd61-6ba5-44a7-9a79-a25f59f6a82d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:31.724310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ecf62-3ad5-405b-a996-6c0443724985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:31.726365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ecf62-3ad5-405b-a996-6c0443724985 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:31.727095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ecf62-3ad5-405b-a996-6c0443724985 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:31.727986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ecf62-3ad5-405b-a996-6c0443724985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:31.739433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:31.745319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ecf62-3ad5-405b-a996-6c0443724985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:31.746421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f4123-14b7-4a54-aa9b-7987f7f412fc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:31.748031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ecf62-3ad5-405b-a996-6c0443724985 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-994ecf62-3ad5-405b-a996-6c0443724985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:31.778249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:31.779205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:31.780082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:31.780082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:31.780082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:31.780082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:31.782852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 406/826] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:31.789319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ecf62-3ad5-405b-a996-6c0443724985 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:31.796387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc0eb-a090-4da4-a52a-8adf82da8f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:31.797084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc0eb-a090-4da4-a52a-8adf82da8f1a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:31.797371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc0eb-a090-4da4-a52a-8adf82da8f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:31.797654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc0eb-a090-4da4-a52a-8adf82da8f1a None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:31.798411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacc0eb-a090-4da4-a52a-8adf82da8f1a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:31.798724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacc0eb-a090-4da4-a52a-8adf82da8f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:31.800492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacc0eb-a090-4da4-a52a-8adf82da8f1a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:31.807350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 421/827] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 17 12:44:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:31.812663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc0eb-a090-4da4-a52a-8adf82da8f1a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:31.905873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ecf62-3ad5-405b-a996-6c0443724985 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:31.931217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc0eb-a090-4da4-a52a-8adf82da8f1a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:31.947455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffcaa7-24ff-4543-b153-93f9783740dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:31.948582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffcaa7-24ff-4543-b153-93f9783740dc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:31.949100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffcaa7-24ff-4543-b153-93f9783740dc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:31.949577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffcaa7-24ff-4543-b153-93f9783740dc None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:31.950661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffcaa7-24ff-4543-b153-93f9783740dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:31.951225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffcaa7-24ff-4543-b153-93f9783740dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:31.952872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffcaa7-24ff-4543-b153-93f9783740dc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:31.970687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0b300-3305-4c69-9eab-c4f6202230a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:31.970687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b300-3305-4c69-9eab-c4f6202230a9 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:31.970687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b300-3305-4c69-9eab-c4f6202230a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:31.971018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b300-3305-4c69-9eab-c4f6202230a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:31.971290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 407/828] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:31.971760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0b300-3305-4c69-9eab-c4f6202230a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:31.972682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffcaa7-24ff-4543-b153-93f9783740dc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:31.973202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0b300-3305-4c69-9eab-c4f6202230a9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:31.983326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:32.006362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 422/829] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 12:44:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:44:32.099586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffcaa7-24ff-4543-b153-93f9783740dc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:32.151625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59d657-a144-46e9-a3d2-9de96295231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:32.152903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59d657-a144-46e9-a3d2-9de96295231a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:32.153391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59d657-a144-46e9-a3d2-9de96295231a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:32.153875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59d657-a144-46e9-a3d2-9de96295231a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:32.162774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59d657-a144-46e9-a3d2-9de96295231a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:32.164687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59d657-a144-46e9-a3d2-9de96295231a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2f59d657-a144-46e9-a3d2-9de96295231a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:32.181713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:32.182728 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:32.183710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:32.183710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:32.183710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:32.183710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:32.183710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:32.183710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:32.183710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:32.183710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:32.186575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 408/830] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:32.192486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0b300-3305-4c69-9eab-c4f6202230a9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:32.216870 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:32.315807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0b300-3305-4c69-9eab-c4f6202230a9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:32.353377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15db81-86d4-4dfa-8a50-cafb94ed4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:32.354062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15db81-86d4-4dfa-8a50-cafb94ed4462 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:32.354372 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15db81-86d4-4dfa-8a50-cafb94ed4462 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:32.354643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15db81-86d4-4dfa-8a50-cafb94ed4462 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:32.355438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15db81-86d4-4dfa-8a50-cafb94ed4462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:32.355743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15db81-86d4-4dfa-8a50-cafb94ed4462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:32.357252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15db81-86d4-4dfa-8a50-cafb94ed4462 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:32.372137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 423/831] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:32.377977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59d657-a144-46e9-a3d2-9de96295231a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:32.450411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:32.495618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59d657-a144-46e9-a3d2-9de96295231a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:32.532322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ad7d9-38d3-40a1-8e0a-516bb67b274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:32.532999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad7d9-38d3-40a1-8e0a-516bb67b274e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:32.533279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad7d9-38d3-40a1-8e0a-516bb67b274e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:32.533558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad7d9-38d3-40a1-8e0a-516bb67b274e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:32.534434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad7d9-38d3-40a1-8e0a-516bb67b274e None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=09a967d14a7243068a016b4677e47234) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:32.534748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad7d9-38d3-40a1-8e0a-516bb67b274e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:32.536318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad7d9-38d3-40a1-8e0a-516bb67b274e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:32.544562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 409/832] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:32 2022] GET /identity/v3/role_assignments?user.id=09a967d14a7243068a016b4677e47234&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:32.832164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2db7de-9e28-4160-9d6f-f60c474e876d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:32.832701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2db7de-9e28-4160-9d6f-f60c474e876d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:32.833182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2db7de-9e28-4160-9d6f-f60c474e876d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:32.835662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 424/833] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:32.841583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4c54-f39a-4940-b66e-65aa6b52a849 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:32.842565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4c54-f39a-4940-b66e-65aa6b52a849 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:32.843063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4c54-f39a-4940-b66e-65aa6b52a849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:32.861656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5b8b4c54-f39a-4940-b66e-65aa6b52a849 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:32.863622 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5b8b4c54-f39a-4940-b66e-65aa6b52a849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:32.949784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 410/834] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:32.973881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2db7de-9e28-4160-9d6f-f60c474e876d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:33.070708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:33.098724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2db7de-9e28-4160-9d6f-f60c474e876d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:33.114766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032e3e-257a-4c4c-ac3e-cd5feab89643 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:33.115487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032e3e-257a-4c4c-ac3e-cd5feab89643 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:33.115487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032e3e-257a-4c4c-ac3e-cd5feab89643 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:33.116986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 411/835] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:33.122474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52122e39-64a2-4c75-a81d-e57736cd745c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:33.122758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52122e39-64a2-4c75-a81d-e57736cd745c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:33.123069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52122e39-64a2-4c75-a81d-e57736cd745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:33.139460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7b5c9-043d-43f8-a36c-7dabbc335c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:33.140291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b5c9-043d-43f8-a36c-7dabbc335c2d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:33.140581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b5c9-043d-43f8-a36c-7dabbc335c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:33.140848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b5c9-043d-43f8-a36c-7dabbc335c2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:33.142496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-52122e39-64a2-4c75-a81d-e57736cd745c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:33.144253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-52122e39-64a2-4c75-a81d-e57736cd745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:33.152957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7b5c9-043d-43f8-a36c-7dabbc335c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-dda7b5c9-043d-43f8-a36c-7dabbc335c2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:33.163557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:33.164629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:33.165473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 425/836] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:33.175193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7b5c9-043d-43f8-a36c-7dabbc335c2d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:33.210446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:33.242297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 412/837] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:44:33.270388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52122e39-64a2-4c75-a81d-e57736cd745c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:33.306374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7b5c9-043d-43f8-a36c-7dabbc335c2d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:33.352767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed2870-e40c-4794-9981-eee984219c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:33.354180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed2870-e40c-4794-9981-eee984219c84 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:33.354697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed2870-e40c-4794-9981-eee984219c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:33.355172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed2870-e40c-4794-9981-eee984219c84 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:33.356623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed2870-e40c-4794-9981-eee984219c84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:33.357142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed2870-e40c-4794-9981-eee984219c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:33.359095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed2870-e40c-4794-9981-eee984219c84 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:33.361832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:33.370618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 426/838] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:33.378030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed2870-e40c-4794-9981-eee984219c84 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:33.406117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52122e39-64a2-4c75-a81d-e57736cd745c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:33.447699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f48794-6eb5-4cbd-bc17-b0c8422e5b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:33.448545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f48794-6eb5-4cbd-bc17-b0c8422e5b2d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:33.448835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f48794-6eb5-4cbd-bc17-b0c8422e5b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:33.449120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f48794-6eb5-4cbd-bc17-b0c8422e5b2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:33.462332 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f48794-6eb5-4cbd-bc17-b0c8422e5b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-41f48794-6eb5-4cbd-bc17-b0c8422e5b2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:33.471614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:33.472807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:33.473973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 413/839] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:44:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:33.479318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f48794-6eb5-4cbd-bc17-b0c8422e5b2d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:33.504662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed2870-e40c-4794-9981-eee984219c84 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:33.535281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:33.543693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ff06-e447-44ee-bb19-613da4719741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:33.544856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ff06-e447-44ee-bb19-613da4719741 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:33.545321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ff06-e447-44ee-bb19-613da4719741 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:33.545762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ff06-e447-44ee-bb19-613da4719741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:33.558867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340ff06-e447-44ee-bb19-613da4719741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:33.560712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340ff06-e447-44ee-bb19-613da4719741 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8340ff06-e447-44ee-bb19-613da4719741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:33.580868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:33.581842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:33.582925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:33.582925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:33.582925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:33.582925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:33.585906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 427/840] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:33.592635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ff06-e447-44ee-bb19-613da4719741 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:33.607723 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f48794-6eb5-4cbd-bc17-b0c8422e5b2d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:33.659188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986c32e-371d-4ee8-8720-883bef8fe316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:33.659886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986c32e-371d-4ee8-8720-883bef8fe316 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:33.660170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986c32e-371d-4ee8-8720-883bef8fe316 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:33.660434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986c32e-371d-4ee8-8720-883bef8fe316 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:33.661696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986c32e-371d-4ee8-8720-883bef8fe316 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:33.662008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986c32e-371d-4ee8-8720-883bef8fe316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:33.663730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986c32e-371d-4ee8-8720-883bef8fe316 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:33.665951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:33.680996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 414/841] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:44:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:33.682954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986c32e-371d-4ee8-8720-883bef8fe316 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:33.747534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ff06-e447-44ee-bb19-613da4719741 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:33.801755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16eef2-038a-4cc7-8ff0-22d9c3b4ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:33.803514 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16eef2-038a-4cc7-8ff0-22d9c3b4ea18 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:33.804054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16eef2-038a-4cc7-8ff0-22d9c3b4ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:33.804529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16eef2-038a-4cc7-8ff0-22d9c3b4ea18 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:33.805521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16eef2-038a-4cc7-8ff0-22d9c3b4ea18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:33.806032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16eef2-038a-4cc7-8ff0-22d9c3b4ea18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:33.807730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16eef2-038a-4cc7-8ff0-22d9c3b4ea18 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:33.829097 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 428/842] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:33.829724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986c32e-371d-4ee8-8720-883bef8fe316 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:33.830798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16eef2-038a-4cc7-8ff0-22d9c3b4ea18 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:33.842399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:33.884472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec66b5-74ed-44cc-996d-6adbf612f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:33.885656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec66b5-74ed-44cc-996d-6adbf612f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:33.886199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec66b5-74ed-44cc-996d-6adbf612f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:33.886571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec66b5-74ed-44cc-996d-6adbf612f7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:33.905140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec66b5-74ed-44cc-996d-6adbf612f7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:33.907700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec66b5-74ed-44cc-996d-6adbf612f7b8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b9ec66b5-74ed-44cc-996d-6adbf612f7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:33.930930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:33.932082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:33.933218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:33.933218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:33.933218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:33.933218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:33.938505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 415/843] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:33.941177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec66b5-74ed-44cc-996d-6adbf612f7b8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:33.962460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16eef2-038a-4cc7-8ff0-22d9c3b4ea18 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:33.975839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:34.005470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92da2c8-4dfb-43c6-b702-b4ef948026b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:34.006659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92da2c8-4dfb-43c6-b702-b4ef948026b7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:34.007085 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92da2c8-4dfb-43c6-b702-b4ef948026b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:34.007499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92da2c8-4dfb-43c6-b702-b4ef948026b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:34.016402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92da2c8-4dfb-43c6-b702-b4ef948026b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:34.018429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92da2c8-4dfb-43c6-b702-b4ef948026b7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e92da2c8-4dfb-43c6-b702-b4ef948026b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:34.035715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:34.036887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 12:44:34.038256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:34.041351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 429/844] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:44:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:34.048025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92da2c8-4dfb-43c6-b702-b4ef948026b7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:34.077179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec66b5-74ed-44cc-996d-6adbf612f7b8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:34.144081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dccba-9c20-48e7-ac7f-99e50c458aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:34.145450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dccba-9c20-48e7-ac7f-99e50c458aeb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:34.145845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dccba-9c20-48e7-ac7f-99e50c458aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:34.147345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dccba-9c20-48e7-ac7f-99e50c458aeb None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:34.148830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3dccba-9c20-48e7-ac7f-99e50c458aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:34.149401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3dccba-9c20-48e7-ac7f-99e50c458aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:34.152394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3dccba-9c20-48e7-ac7f-99e50c458aeb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:34.182570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92da2c8-4dfb-43c6-b702-b4ef948026b7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:34.182803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 416/845] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:34.189298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dccba-9c20-48e7-ac7f-99e50c458aeb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:34.220078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:34.234736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b31a-a3cd-4d2e-bfe5-459224e96584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:34.236485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b31a-a3cd-4d2e-bfe5-459224e96584 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:34.237003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b31a-a3cd-4d2e-bfe5-459224e96584 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:34.237519 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b31a-a3cd-4d2e-bfe5-459224e96584 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:34.239756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4b31a-a3cd-4d2e-bfe5-459224e96584 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:34.241956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4b31a-a3cd-4d2e-bfe5-459224e96584 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:34.244444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4b31a-a3cd-4d2e-bfe5-459224e96584 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:34.277004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 430/846] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 17 12:44:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:34.284686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b31a-a3cd-4d2e-bfe5-459224e96584 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:34.335338 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:34.351181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dccba-9c20-48e7-ac7f-99e50c458aeb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:34.409438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b19d61-0ecf-4fff-9562-98a7ce1c1ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:34.410715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b19d61-0ecf-4fff-9562-98a7ce1c1ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:34.411393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b19d61-0ecf-4fff-9562-98a7ce1c1ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:34.411867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b19d61-0ecf-4fff-9562-98a7ce1c1ec0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:34.422194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b19d61-0ecf-4fff-9562-98a7ce1c1ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:34.424079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b19d61-0ecf-4fff-9562-98a7ce1c1ec0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-84b19d61-0ecf-4fff-9562-98a7ce1c1ec0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:34.441851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:34.442951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:34.443908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:34.445748 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b31a-a3cd-4d2e-bfe5-459224e96584 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:34.452233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 417/847] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:44:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:34.453703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b19d61-0ecf-4fff-9562-98a7ce1c1ec0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:34.503132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2c7b8-56cb-4455-89e9-ae0b1d0bfb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:34.503837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2c7b8-56cb-4455-89e9-ae0b1d0bfb63 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:34.504116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2c7b8-56cb-4455-89e9-ae0b1d0bfb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:34.504390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2c7b8-56cb-4455-89e9-ae0b1d0bfb63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:34.558721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:34.581873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b19d61-0ecf-4fff-9562-98a7ce1c1ec0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:34.586984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2c7b8-56cb-4455-89e9-ae0b1d0bfb63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:34.588625 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2c7b8-56cb-4455-89e9-ae0b1d0bfb63 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:34.619644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:34.624794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e0f5f-cf49-493d-92de-5a9507ee25cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:34.625501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e0f5f-cf49-493d-92de-5a9507ee25cf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:34.625789 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e0f5f-cf49-493d-92de-5a9507ee25cf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:34.626070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e0f5f-cf49-493d-92de-5a9507ee25cf None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:34.626968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e0f5f-cf49-493d-92de-5a9507ee25cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:34.627280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e0f5f-cf49-493d-92de-5a9507ee25cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:34.628800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e0f5f-cf49-493d-92de-5a9507ee25cf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:34.654361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 418/848] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 12:44:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:34.654361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc653983-b65b-4567-b474-dd9dce25ced7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:34.654361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc653983-b65b-4567-b474-dd9dce25ced7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:34.654361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc653983-b65b-4567-b474-dd9dce25ced7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:34.654361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 419/849] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:34.658656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc653983-b65b-4567-b474-dd9dce25ced7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:34.717974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 431/850] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 12:44:34.723340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f8f24-6138-405a-824e-4f28de9314b6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:34.723770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f8f24-6138-405a-824e-4f28de9314b6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:34.724049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f8f24-6138-405a-824e-4f28de9314b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:34.743809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-685f8f24-6138-405a-824e-4f28de9314b6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:34.745041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-685f8f24-6138-405a-824e-4f28de9314b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:34.783853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc653983-b65b-4567-b474-dd9dce25ced7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:34.821163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e7ab-b285-49c5-91e8-c48ebb53111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:34.821836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e7ab-b285-49c5-91e8-c48ebb53111e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:34.822300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e7ab-b285-49c5-91e8-c48ebb53111e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:34.822766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e7ab-b285-49c5-91e8-c48ebb53111e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:34.831167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 432/851] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:34.832071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f8f24-6138-405a-824e-4f28de9314b6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:34.839288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:34.917197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:34.928038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e7ab-b285-49c5-91e8-c48ebb53111e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:34.929525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e7ab-b285-49c5-91e8-c48ebb53111e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:34.974120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f8f24-6138-405a-824e-4f28de9314b6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:35.013975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a740e0-46b2-4776-8b2e-cdb25ae93df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:35.014917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a740e0-46b2-4776-8b2e-cdb25ae93df3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.015146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a740e0-46b2-4776-8b2e-cdb25ae93df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.015420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a740e0-46b2-4776-8b2e-cdb25ae93df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.027070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a740e0-46b2-4776-8b2e-cdb25ae93df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:35.028583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a740e0-46b2-4776-8b2e-cdb25ae93df3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e3a740e0-46b2-4776-8b2e-cdb25ae93df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:35.049100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:35.050083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:35.051040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:35.051040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:35.051040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:35.051040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:35.051040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 433/852] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:35.051326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a740e0-46b2-4776-8b2e-cdb25ae93df3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.056133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 420/853] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:35.057542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5219c-e9d2-415b-8640-b308dc197f6c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.057883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5219c-e9d2-415b-8640-b308dc197f6c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.058309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5219c-e9d2-415b-8640-b308dc197f6c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.059759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 421/854] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:35.062135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5219c-e9d2-415b-8640-b308dc197f6c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.109583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:35.166411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a740e0-46b2-4776-8b2e-cdb25ae93df3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:35.177835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:35.179620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5219c-e9d2-415b-8640-b308dc197f6c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:35.204277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82176c8-4600-4562-9753-7029591fbe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:35.205157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82176c8-4600-4562-9753-7029591fbe3f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.205402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82176c8-4600-4562-9753-7029591fbe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.205675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82176c8-4600-4562-9753-7029591fbe3f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.206378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82176c8-4600-4562-9753-7029591fbe3f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:35.207821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82176c8-4600-4562-9753-7029591fbe3f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:35.220295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5bb7e-790d-4f8b-9772-3b322c53d841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:35.221001 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5bb7e-790d-4f8b-9772-3b322c53d841 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b82176c8-4600-4562-9753-7029591fbe3f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:35.221140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:35.222310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 12:44:35.223144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:35.224638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5bb7e-790d-4f8b-9772-3b322c53d841 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.224638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5bb7e-790d-4f8b-9772-3b322c53d841 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.224781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 434/855] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:35.224848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5bb7e-790d-4f8b-9772-3b322c53d841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:35.224915 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82176c8-4600-4562-9753-7029591fbe3f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.224980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5bb7e-790d-4f8b-9772-3b322c53d841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:35.226143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5bb7e-790d-4f8b-9772-3b322c53d841 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:35.242163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 422/856] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:35.243555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489df8e-200f-4b83-94ca-478a30f5b0ae None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.243889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489df8e-200f-4b83-94ca-478a30f5b0ae None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.244235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489df8e-200f-4b83-94ca-478a30f5b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.262468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b489df8e-200f-4b83-94ca-478a30f5b0ae None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:35.263796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b489df8e-200f-4b83-94ca-478a30f5b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:35.341284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 423/857] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:35.342205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489df8e-200f-4b83-94ca-478a30f5b0ae None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.376800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:35.386083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82176c8-4600-4562-9753-7029591fbe3f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:35.439128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4e8f0-bc5a-4213-840a-733e841a9a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:35.439965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4e8f0-bc5a-4213-840a-733e841a9a0a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.440234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4e8f0-bc5a-4213-840a-733e841a9a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.440518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4e8f0-bc5a-4213-840a-733e841a9a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.452973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4e8f0-bc5a-4213-840a-733e841a9a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:35.454527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4e8f0-bc5a-4213-840a-733e841a9a0a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:35.461130 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489df8e-200f-4b83-94ca-478a30f5b0ae None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-fab4e8f0-bc5a-4213-840a-733e841a9a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:35.473516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:35.474626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:35.476776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:35.476776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:35.476776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:35.476776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:35.476776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 435/858] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:35.476776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4e8f0-bc5a-4213-840a-733e841a9a0a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.500919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f1f7-1e8f-4f64-ad38-d0b3131833b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:35.501616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f1f7-1e8f-4f64-ad38-d0b3131833b7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.501901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f1f7-1e8f-4f64-ad38-d0b3131833b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.502208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f1f7-1e8f-4f64-ad38-d0b3131833b7 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.502948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5f1f7-1e8f-4f64-ad38-d0b3131833b7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:35.503261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5f1f7-1e8f-4f64-ad38-d0b3131833b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:35.504689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5f1f7-1e8f-4f64-ad38-d0b3131833b7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:35.508467 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:35.510937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 424/859] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:35.511817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f1f7-1e8f-4f64-ad38-d0b3131833b7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.620821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4e8f0-bc5a-4213-840a-733e841a9a0a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:35.632657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:35.643528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f1f7-1e8f-4f64-ad38-d0b3131833b7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:35.679249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1441c-8ba1-4dc6-bb0a-fa74a7c4da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:35.680097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1441c-8ba1-4dc6-bb0a-fa74a7c4da82 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.680377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1441c-8ba1-4dc6-bb0a-fa74a7c4da82 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.680651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1441c-8ba1-4dc6-bb0a-fa74a7c4da82 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.680784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b92005-22e0-41e6-9e81-fadf539938fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:35.681388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1441c-8ba1-4dc6-bb0a-fa74a7c4da82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:35.682219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b92005-22e0-41e6-9e81-fadf539938fc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.682724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b92005-22e0-41e6-9e81-fadf539938fc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.682822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1441c-8ba1-4dc6-bb0a-fa74a7c4da82 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:35.683223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b92005-22e0-41e6-9e81-fadf539938fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.696032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b92005-22e0-41e6-9e81-fadf539938fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b8b1441c-8ba1-4dc6-bb0a-fa74a7c4da82 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:35.696236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:35.697248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:35.698268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 425/860] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:35.699648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1441c-8ba1-4dc6-bb0a-fa74a7c4da82 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.700876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b92005-22e0-41e6-9e81-fadf539938fc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c1b92005-22e0-41e6-9e81-fadf539938fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:35.718929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:35.720588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 436/861] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:35.722299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b92005-22e0-41e6-9e81-fadf539938fc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.815328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:35.816344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1441c-8ba1-4dc6-bb0a-fa74a7c4da82 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:35.832168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b92005-22e0-41e6-9e81-fadf539938fc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:35.852689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a546725-b2f5-41ae-9cc7-ae8cbd2bdc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:35.853367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a546725-b2f5-41ae-9cc7-ae8cbd2bdc8e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.853671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a546725-b2f5-41ae-9cc7-ae8cbd2bdc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.853937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a546725-b2f5-41ae-9cc7-ae8cbd2bdc8e None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.854709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a546725-b2f5-41ae-9cc7-ae8cbd2bdc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:35.855021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a546725-b2f5-41ae-9cc7-ae8cbd2bdc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:35.856417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a546725-b2f5-41ae-9cc7-ae8cbd2bdc8e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:35.869280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 426/862] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:35.869767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de00e4d-7f92-4f42-94c6-d61c7a46f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:35.870138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a546725-b2f5-41ae-9cc7-ae8cbd2bdc8e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.870492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de00e4d-7f92-4f42-94c6-d61c7a46f8da None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:35.870751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de00e4d-7f92-4f42-94c6-d61c7a46f8da None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:35.871021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de00e4d-7f92-4f42-94c6-d61c7a46f8da None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:35.871737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de00e4d-7f92-4f42-94c6-d61c7a46f8da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:35.872030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de00e4d-7f92-4f42-94c6-d61c7a46f8da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:35.873448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de00e4d-7f92-4f42-94c6-d61c7a46f8da None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:35.890120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 437/863] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:35.890120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de00e4d-7f92-4f42-94c6-d61c7a46f8da None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:35.898161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:36.012327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a546725-b2f5-41ae-9cc7-ae8cbd2bdc8e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:36.015538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de00e4d-7f92-4f42-94c6-d61c7a46f8da None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:36.059231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b977bf8-e0fe-4f01-a794-23d60670e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:36.060608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b977bf8-e0fe-4f01-a794-23d60670e1ef None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:36.060608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b977bf8-e0fe-4f01-a794-23d60670e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:36.061680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b977bf8-e0fe-4f01-a794-23d60670e1ef None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:36.064498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b977bf8-e0fe-4f01-a794-23d60670e1ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:36.065121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b977bf8-e0fe-4f01-a794-23d60670e1ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:36.068231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b977bf8-e0fe-4f01-a794-23d60670e1ef None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:36.073999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86437a-7daa-4c78-b626-cad82d54f47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:36.074996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86437a-7daa-4c78-b626-cad82d54f47c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:36.075527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86437a-7daa-4c78-b626-cad82d54f47c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:36.076051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86437a-7daa-4c78-b626-cad82d54f47c None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:36.077011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86437a-7daa-4c78-b626-cad82d54f47c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:36.077457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86437a-7daa-4c78-b626-cad82d54f47c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:36.079253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86437a-7daa-4c78-b626-cad82d54f47c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:36.085983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 427/864] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:36.087557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86437a-7daa-4c78-b626-cad82d54f47c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:36.094869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 438/865] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:36.096670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b977bf8-e0fe-4f01-a794-23d60670e1ef None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:36.121422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:36.187918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:36.212732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86437a-7daa-4c78-b626-cad82d54f47c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:36.251997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6f5e-c8ed-488d-bc1e-daaa89ecf0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:36.252968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6f5e-c8ed-488d-bc1e-daaa89ecf0ca None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:36.253329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6f5e-c8ed-488d-bc1e-daaa89ecf0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:36.253695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6f5e-c8ed-488d-bc1e-daaa89ecf0ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:36.262370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa6f5e-c8ed-488d-bc1e-daaa89ecf0ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:36.264010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa6f5e-c8ed-488d-bc1e-daaa89ecf0ca None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9efa6f5e-c8ed-488d-bc1e-daaa89ecf0ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:36.279804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:36.281007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:36.282210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:36.282210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:36.282210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:36.282210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:36.282210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:36.282210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:36.282210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:36.282210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:36.282742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b977bf8-e0fe-4f01-a794-23d60670e1ef None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:36.288469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 428/866] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:36.288469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6f5e-c8ed-488d-bc1e-daaa89ecf0ca None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:36.328499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b687e4-2174-4891-987e-ce883f4bb2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:36.329094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b687e4-2174-4891-987e-ce883f4bb2ff None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:36.329374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b687e4-2174-4891-987e-ce883f4bb2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:36.329648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b687e4-2174-4891-987e-ce883f4bb2ff None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:36.330412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b687e4-2174-4891-987e-ce883f4bb2ff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:36.330718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b687e4-2174-4891-987e-ce883f4bb2ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:36.332142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b687e4-2174-4891-987e-ce883f4bb2ff None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:36.337579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 439/867] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:36.338464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b687e4-2174-4891-987e-ce883f4bb2ff None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:36.450953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:36.457469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6f5e-c8ed-488d-bc1e-daaa89ecf0ca None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:36.489813 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b687e4-2174-4891-987e-ce883f4bb2ff None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:36.508515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f668a8-058d-436d-87d5-58a4b4888a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:36.510435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f668a8-058d-436d-87d5-58a4b4888a11 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:36.511009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f668a8-058d-436d-87d5-58a4b4888a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:36.511775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f668a8-058d-436d-87d5-58a4b4888a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:36.513216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f668a8-058d-436d-87d5-58a4b4888a11 None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=ed5fff4bed294d16a0e1d5fec4991c58) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:36.513754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f668a8-058d-436d-87d5-58a4b4888a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:36.515993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f668a8-058d-436d-87d5-58a4b4888a11 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:36.524675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 429/868] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:36 2022] GET /identity/v3/role_assignments?user.id=ed5fff4bed294d16a0e1d5fec4991c58&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:36.539039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc326f-ad39-4dff-8d9e-bf456110b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:36.540034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc326f-ad39-4dff-8d9e-bf456110b050 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:36.540324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc326f-ad39-4dff-8d9e-bf456110b050 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:36.540655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc326f-ad39-4dff-8d9e-bf456110b050 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:36.541705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc326f-ad39-4dff-8d9e-bf456110b050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:36.542151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc326f-ad39-4dff-8d9e-bf456110b050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:36.544002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc326f-ad39-4dff-8d9e-bf456110b050 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:36.560489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 440/869] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:36.566629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f668a8-058d-436d-87d5-58a4b4888a11 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:36.572480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:36.705747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f668a8-058d-436d-87d5-58a4b4888a11 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:36.749310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d911a-ab69-4c74-8928-d31743516838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:36.750248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d911a-ab69-4c74-8928-d31743516838 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:36.750532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d911a-ab69-4c74-8928-d31743516838 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:36.750838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d911a-ab69-4c74-8928-d31743516838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:36.751745 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d911a-ab69-4c74-8928-d31743516838 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=3b34545615e447329344a942cd31c12a) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:36.752061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d911a-ab69-4c74-8928-d31743516838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:36.753734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d911a-ab69-4c74-8928-d31743516838 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:36.762161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 430/870] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:36 2022] GET /identity/v3/role_assignments?user.id=3b34545615e447329344a942cd31c12a&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:38.942082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0386f9c-9633-485f-ba71-3b591050caf3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:38.943177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0386f9c-9633-485f-ba71-3b591050caf3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:38.943177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0386f9c-9633-485f-ba71-3b591050caf3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:38.945188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 441/871] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:38.951880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1817-eddd-46d8-82e6-7d606eb41d2c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:38.952660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1817-eddd-46d8-82e6-7d606eb41d2c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:38.952660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1817-eddd-46d8-82e6-7d606eb41d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:38.972057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-864a1817-eddd-46d8-82e6-7d606eb41d2c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:38.973275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-864a1817-eddd-46d8-82e6-7d606eb41d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:39.020475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def14f97-523f-4267-b04a-8ce857571044 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.021275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def14f97-523f-4267-b04a-8ce857571044 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.021780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def14f97-523f-4267-b04a-8ce857571044 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.024980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 442/872] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:39.030481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3119a-d7f8-4389-9dd9-c60b7acfa928 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.031142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3119a-d7f8-4389-9dd9-c60b7acfa928 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.031643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3119a-d7f8-4389-9dd9-c60b7acfa928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.051513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f0a3119a-d7f8-4389-9dd9-c60b7acfa928 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:39.052834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f0a3119a-d7f8-4389-9dd9-c60b7acfa928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:39.057444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:39.070695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 431/873] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:39.093231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1817-eddd-46d8-82e6-7d606eb41d2c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:39.143724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 443/874] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:44:39.189361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3119a-d7f8-4389-9dd9-c60b7acfa928 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:39.222706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1817-eddd-46d8-82e6-7d606eb41d2c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:39.271257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef0a93-38f1-4e65-8568-15dd3b8501ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:39.272336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef0a93-38f1-4e65-8568-15dd3b8501ce None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.272866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef0a93-38f1-4e65-8568-15dd3b8501ce None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.273180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef0a93-38f1-4e65-8568-15dd3b8501ce None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.273886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef0a93-38f1-4e65-8568-15dd3b8501ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:39.275365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef0a93-38f1-4e65-8568-15dd3b8501ce None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:39.279284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:39.294635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 432/875] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:44:39 2022] POST /identity/v3/services => generated 269 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:44:39.296482 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f195-4a38-4ade-ba23-efcb2e4f4c7a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.296829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f195-4a38-4ade-ba23-efcb2e4f4c7a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.297417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f195-4a38-4ade-ba23-efcb2e4f4c7a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.303028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 433/876] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:39.304978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc01691-c6ce-4821-bf45-64af7be90ab9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.305821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc01691-c6ce-4821-bf45-64af7be90ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.306188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc01691-c6ce-4821-bf45-64af7be90ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.336693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7bc01691-c6ce-4821-bf45-64af7be90ab9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:39.339261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7bc01691-c6ce-4821-bf45-64af7be90ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:39.342342 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3119a-d7f8-4389-9dd9-c60b7acfa928 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:39.414888 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d566-ccf7-4427-96ac-6eac66b6ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:39.416102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d566-ccf7-4427-96ac-6eac66b6ee9c None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.416562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d566-ccf7-4427-96ac-6eac66b6ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.417075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d566-ccf7-4427-96ac-6eac66b6ee9c None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.418012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86d566-ccf7-4427-96ac-6eac66b6ee9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:39.420604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86d566-ccf7-4427-96ac-6eac66b6ee9c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:39.424684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:39.450311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 434/877] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:39 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:39.466327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 444/878] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:44:39 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:44:39.474073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc01691-c6ce-4821-bf45-64af7be90ab9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:39.628157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc01691-c6ce-4821-bf45-64af7be90ab9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:39.678863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dd36e-3c01-481b-971b-cc4d7d905390 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.679154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dd36e-3c01-481b-971b-cc4d7d905390 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.679436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dd36e-3c01-481b-971b-cc4d7d905390 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.681120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 445/879] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:39.688821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f6262-cecb-4ca9-9dc7-a933f24d0d4b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.689223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f6262-cecb-4ca9-9dc7-a933f24d0d4b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.689373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f6262-cecb-4ca9-9dc7-a933f24d0d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.690927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606c82-d9c4-4469-a2e8-ebdf39510c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:39.691795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606c82-d9c4-4469-a2e8-ebdf39510c28 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.692082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606c82-d9c4-4469-a2e8-ebdf39510c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.692800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d606c82-d9c4-4469-a2e8-ebdf39510c28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.712617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-082f6262-cecb-4ca9-9dc7-a933f24d0d4b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:39.713860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-082f6262-cecb-4ca9-9dc7-a933f24d0d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:39.714028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d606c82-d9c4-4469-a2e8-ebdf39510c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5d606c82-d9c4-4469-a2e8-ebdf39510c28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:39.729691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:39.730786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:44:39.731798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:39.732474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 435/880] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 12:44:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:39.739218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606c82-d9c4-4469-a2e8-ebdf39510c28 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:39.798264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:39.837099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 446/881] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:39.859303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f6262-cecb-4ca9-9dc7-a933f24d0d4b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:39.886149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d606c82-d9c4-4469-a2e8-ebdf39510c28 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:39.925946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:39.943524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3993bae-9160-40d9-8bd9-ebafdc3d4496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:39.945203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993bae-9160-40d9-8bd9-ebafdc3d4496 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:39.946160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993bae-9160-40d9-8bd9-ebafdc3d4496 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:39.947099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993bae-9160-40d9-8bd9-ebafdc3d4496 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:39.949011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993bae-9160-40d9-8bd9-ebafdc3d4496 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:39.949858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993bae-9160-40d9-8bd9-ebafdc3d4496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:39.953120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993bae-9160-40d9-8bd9-ebafdc3d4496 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:39.978946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 436/882] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 12:44:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:39.984120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3993bae-9160-40d9-8bd9-ebafdc3d4496 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:39.995052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f6262-cecb-4ca9-9dc7-a933f24d0d4b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:40.042535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd7f8-0e2c-4985-aecc-14053df96646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:40.043387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd7f8-0e2c-4985-aecc-14053df96646 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:40.043664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd7f8-0e2c-4985-aecc-14053df96646 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:40.043935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd7f8-0e2c-4985-aecc-14053df96646 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:40.044600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cd7f8-0e2c-4985-aecc-14053df96646 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:40.046031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cd7f8-0e2c-4985-aecc-14053df96646 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1d3cd7f8-0e2c-4985-aecc-14053df96646 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:40.063228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:40.064320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:40.065188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 447/883] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:40.075285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd7f8-0e2c-4985-aecc-14053df96646 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:40.136005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3993bae-9160-40d9-8bd9-ebafdc3d4496 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:40.146075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:40.183099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94026c-861c-4e62-a385-11e3037be787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:40.185045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94026c-861c-4e62-a385-11e3037be787 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:40.185830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94026c-861c-4e62-a385-11e3037be787 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:40.186471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94026c-861c-4e62-a385-11e3037be787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:40.208241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94026c-861c-4e62-a385-11e3037be787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:40.210779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94026c-861c-4e62-a385-11e3037be787 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:40.224252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd7f8-0e2c-4985-aecc-14053df96646 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:40.242702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ec94026c-861c-4e62-a385-11e3037be787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:40.248499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:40.249467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:40.250391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:40.250391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:40.250391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:40.250391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:40.256791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 437/884] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:40.260494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94026c-861c-4e62-a385-11e3037be787 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:40.273079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972921f1-c755-4c7c-88ab-a2cef8156da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:40.274197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972921f1-c755-4c7c-88ab-a2cef8156da5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:40.274811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972921f1-c755-4c7c-88ab-a2cef8156da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:40.275300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972921f1-c755-4c7c-88ab-a2cef8156da5 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:40.276275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972921f1-c755-4c7c-88ab-a2cef8156da5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:40.277559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972921f1-c755-4c7c-88ab-a2cef8156da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:40.279417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972921f1-c755-4c7c-88ab-a2cef8156da5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:40.287204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 448/885] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:40.295687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972921f1-c755-4c7c-88ab-a2cef8156da5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:40.436305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94026c-861c-4e62-a385-11e3037be787 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:40.446024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972921f1-c755-4c7c-88ab-a2cef8156da5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:40.476194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3881e8b-b2cf-4a8c-a9d0-fcbf86e9c945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:40.477035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3881e8b-b2cf-4a8c-a9d0-fcbf86e9c945 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:40.477386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3881e8b-b2cf-4a8c-a9d0-fcbf86e9c945 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:40.477901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3881e8b-b2cf-4a8c-a9d0-fcbf86e9c945 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:40.478828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3881e8b-b2cf-4a8c-a9d0-fcbf86e9c945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:40.479144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3881e8b-b2cf-4a8c-a9d0-fcbf86e9c945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:40.481198 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3881e8b-b2cf-4a8c-a9d0-fcbf86e9c945 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:40.495017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197a55-54d8-4c3d-85b6-2ffd0d0ce7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:40.495827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197a55-54d8-4c3d-85b6-2ffd0d0ce7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:40.496184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197a55-54d8-4c3d-85b6-2ffd0d0ce7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:40.496522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197a55-54d8-4c3d-85b6-2ffd0d0ce7f0 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:40.497336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f197a55-54d8-4c3d-85b6-2ffd0d0ce7f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:40.497701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f197a55-54d8-4c3d-85b6-2ffd0d0ce7f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:40.499325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f197a55-54d8-4c3d-85b6-2ffd0d0ce7f0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:40.502063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 438/886] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:40.503556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3881e8b-b2cf-4a8c-a9d0-fcbf86e9c945 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:40.506706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 449/887] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:40.531424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:40.634791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3881e8b-b2cf-4a8c-a9d0-fcbf86e9c945 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:40.677291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cba73-1077-4378-91ed-0801f8674dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:40.678444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cba73-1077-4378-91ed-0801f8674dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:40.678781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cba73-1077-4378-91ed-0801f8674dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:40.679059 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cba73-1077-4378-91ed-0801f8674dd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:40.688842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cba73-1077-4378-91ed-0801f8674dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:40.690490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cba73-1077-4378-91ed-0801f8674dd1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e35cba73-1077-4378-91ed-0801f8674dd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:40.707767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:40.710742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:40.713547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 439/888] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:44:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:40.716149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197a55-54d8-4c3d-85b6-2ffd0d0ce7f0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:40.770210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:40.841641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197a55-54d8-4c3d-85b6-2ffd0d0ce7f0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:40.882751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33295c87-d2d7-4270-bf50-40b5e4fc13b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:40.883449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295c87-d2d7-4270-bf50-40b5e4fc13b3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:40.883726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295c87-d2d7-4270-bf50-40b5e4fc13b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:40.883994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295c87-d2d7-4270-bf50-40b5e4fc13b3 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:40.884938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295c87-d2d7-4270-bf50-40b5e4fc13b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:40.885242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295c87-d2d7-4270-bf50-40b5e4fc13b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:40.886782 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295c87-d2d7-4270-bf50-40b5e4fc13b3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:40.909504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 450/889] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 12:44:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:40.919134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cba73-1077-4378-91ed-0801f8674dd1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:41.016239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:41.054612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cba73-1077-4378-91ed-0801f8674dd1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:41.092420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1910a-ab34-40cc-a7d4-c8a8ae91414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:41.093093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1910a-ab34-40cc-a7d4-c8a8ae91414a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:41.093378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1910a-ab34-40cc-a7d4-c8a8ae91414a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:41.093654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1910a-ab34-40cc-a7d4-c8a8ae91414a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:41.167135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1910a-ab34-40cc-a7d4-c8a8ae91414a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:41.168634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1910a-ab34-40cc-a7d4-c8a8ae91414a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:41.252600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:41.276346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 440/890] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:40 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:41.282129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33295c87-d2d7-4270-bf50-40b5e4fc13b3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:41.396019 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33295c87-d2d7-4270-bf50-40b5e4fc13b3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:41.399414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:41.437544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc9677-3bf0-4577-a420-15c637fc1a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:41.438444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc9677-3bf0-4577-a420-15c637fc1a64 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:41.438729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc9677-3bf0-4577-a420-15c637fc1a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:41.439009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc9677-3bf0-4577-a420-15c637fc1a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:41.450485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc9677-3bf0-4577-a420-15c637fc1a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:41.451997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc9677-3bf0-4577-a420-15c637fc1a64 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-aecc9677-3bf0-4577-a420-15c637fc1a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:41.476018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:41.477045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:41.478474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:41.478474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:41.478474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:41.478474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:41.478474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 451/891] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:41.484090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1910a-ab34-40cc-a7d4-c8a8ae91414a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:41.595719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1910a-ab34-40cc-a7d4-c8a8ae91414a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:41.636160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa56327-e365-47e9-a21f-9862c3a44905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:41.636871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa56327-e365-47e9-a21f-9862c3a44905 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:41.637182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa56327-e365-47e9-a21f-9862c3a44905 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:41.637462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa56327-e365-47e9-a21f-9862c3a44905 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:41.638269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa56327-e365-47e9-a21f-9862c3a44905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:41.638580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa56327-e365-47e9-a21f-9862c3a44905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:41.640057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa56327-e365-47e9-a21f-9862c3a44905 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:41.654236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 441/892] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:41.660045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc9677-3bf0-4577-a420-15c637fc1a64 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:41.703441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177570-9244-4e08-8876-12789503d265 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:41.703713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177570-9244-4e08-8876-12789503d265 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:41.704053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53177570-9244-4e08-8876-12789503d265 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:41.705771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 442/893] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:41.712863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e93fa-15d9-41bf-ad44-5fdb603c1e50 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:41.713130 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e93fa-15d9-41bf-ad44-5fdb603c1e50 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:41.713452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e93fa-15d9-41bf-ad44-5fdb603c1e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:41.732212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-201e93fa-15d9-41bf-ad44-5fdb603c1e50 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:41.733428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-201e93fa-15d9-41bf-ad44-5fdb603c1e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:41.776368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:41.813661 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc9677-3bf0-4577-a420-15c637fc1a64 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:41.830327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 443/894] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:41.863653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e93fa-15d9-41bf-ad44-5fdb603c1e50 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:41.869899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e9112-c85d-4586-99b7-2b21935c07f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:41.872107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e9112-c85d-4586-99b7-2b21935c07f7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:41.873134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e9112-c85d-4586-99b7-2b21935c07f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:41.873902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e9112-c85d-4586-99b7-2b21935c07f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:41.883455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e9112-c85d-4586-99b7-2b21935c07f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:41.886378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e9112-c85d-4586-99b7-2b21935c07f7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-933e9112-c85d-4586-99b7-2b21935c07f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:41.908955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:41.910727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:41.912508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:41.912508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:41.912508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:41.912508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:41.912508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:41.912508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:41.912508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:41.912508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:41.916578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 452/895] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:41.926238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e9112-c85d-4586-99b7-2b21935c07f7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:41.953827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:42.003855 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e93fa-15d9-41bf-ad44-5fdb603c1e50 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:42.047380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3b361-76a0-41ca-b756-d9935ff336aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:42.048364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3b361-76a0-41ca-b756-d9935ff336aa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.048503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3b361-76a0-41ca-b756-d9935ff336aa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.048851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3b361-76a0-41ca-b756-d9935ff336aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.049440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3b361-76a0-41ca-b756-d9935ff336aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:42.051192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3b361-76a0-41ca-b756-d9935ff336aa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c4e3b361-76a0-41ca-b756-d9935ff336aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:42.066930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:42.068870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 12:44:42.070406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:42.073342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 444/896] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Jun 17 12:44:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:42.074282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3b361-76a0-41ca-b756-d9935ff336aa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:42.115395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:42.131984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e9112-c85d-4586-99b7-2b21935c07f7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:42.178476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba510a-bb89-4425-b53a-85400faca142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:42.179175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba510a-bb89-4425-b53a-85400faca142 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.179468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba510a-bb89-4425-b53a-85400faca142 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.179741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba510a-bb89-4425-b53a-85400faca142 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.180541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba510a-bb89-4425-b53a-85400faca142 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:42.180849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba510a-bb89-4425-b53a-85400faca142 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:42.182373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba510a-bb89-4425-b53a-85400faca142 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:42.202451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 453/897] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:42.204244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba510a-bb89-4425-b53a-85400faca142 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:42.226935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3b361-76a0-41ca-b756-d9935ff336aa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:42.270356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e653de-450e-424e-b743-594f03955889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:42.271792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e653de-450e-424e-b743-594f03955889 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.272080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e653de-450e-424e-b743-594f03955889 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.272370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e653de-450e-424e-b743-594f03955889 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.273109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e653de-450e-424e-b743-594f03955889 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:42.273466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e653de-450e-424e-b743-594f03955889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:42.274901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e653de-450e-424e-b743-594f03955889 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:42.285429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 445/898] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:42.287171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e653de-450e-424e-b743-594f03955889 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:42.308240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:42.344220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba510a-bb89-4425-b53a-85400faca142 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:42.384490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d5658-ffd1-4121-80f6-15ad21607a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:42.389666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d5658-ffd1-4121-80f6-15ad21607a68 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.389666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d5658-ffd1-4121-80f6-15ad21607a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.389666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d5658-ffd1-4121-80f6-15ad21607a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.389666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d5658-ffd1-4121-80f6-15ad21607a68 None admin] RBAC: Adding query filter params (role.id=aa601cdd14964e958fd1ee007671e7f9, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=3b34545615e447329344a942cd31c12a) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:42.389666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d5658-ffd1-4121-80f6-15ad21607a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:42.389666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d5658-ffd1-4121-80f6-15ad21607a68 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:42.396576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 454/899] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:42 2022] GET /identity/v3/role_assignments?user.id=3b34545615e447329344a942cd31c12a&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=aa601cdd14964e958fd1ee007671e7f9 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:42.413215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:42.421452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e653de-450e-424e-b743-594f03955889 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:42.470941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a3f89-5da9-4e3a-ac3b-be187e6d31f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:42.472077 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a3f89-5da9-4e3a-ac3b-be187e6d31f1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.472584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a3f89-5da9-4e3a-ac3b-be187e6d31f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.473197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a3f89-5da9-4e3a-ac3b-be187e6d31f1 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.474441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a3f89-5da9-4e3a-ac3b-be187e6d31f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:42.475325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a3f89-5da9-4e3a-ac3b-be187e6d31f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:42.476985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a3f89-5da9-4e3a-ac3b-be187e6d31f1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:42.483926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 446/900] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:42.491395 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d5658-ffd1-4121-80f6-15ad21607a68 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:42.625791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d5658-ffd1-4121-80f6-15ad21607a68 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:42.667214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af145da5-a1ea-4317-b32a-2301ac9a1b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:42.668308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af145da5-a1ea-4317-b32a-2301ac9a1b3d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.668808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af145da5-a1ea-4317-b32a-2301ac9a1b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.669323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af145da5-a1ea-4317-b32a-2301ac9a1b3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.670486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af145da5-a1ea-4317-b32a-2301ac9a1b3d None admin] RBAC: Adding query filter params (interface=public, service_id=fa53a2a7f8f144d1bede5116769ba0b7, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:42.671062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af145da5-a1ea-4317-b32a-2301ac9a1b3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:42.672926 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af145da5-a1ea-4317-b32a-2301ac9a1b3d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:42.676530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:42.681680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 455/901] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 12:44:42 2022] GET /identity/v3/endpoints?service_id=fa53a2a7f8f144d1bede5116769ba0b7&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:42.688256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a3f89-5da9-4e3a-ac3b-be187e6d31f1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:42.733468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bd720-919d-4c08-bb1e-25594bd8917b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.733775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bd720-919d-4c08-bb1e-25594bd8917b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.734031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bd720-919d-4c08-bb1e-25594bd8917b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.735825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 456/902] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:42.742816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c792d-6e99-4891-afc0-cda677babdc9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.743071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c792d-6e99-4891-afc0-cda677babdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.743322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c792d-6e99-4891-afc0-cda677babdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.762225 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-be7c792d-6e99-4891-afc0-cda677babdc9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:42.763456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-be7c792d-6e99-4891-afc0-cda677babdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:42.822602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a3f89-5da9-4e3a-ac3b-be187e6d31f1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:42.865192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 457/903] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:44:42.866151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6407f46-e5a5-4876-97df-e2947f13133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:42.867084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6407f46-e5a5-4876-97df-e2947f13133d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.867492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6407f46-e5a5-4876-97df-e2947f13133d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.867906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6407f46-e5a5-4876-97df-e2947f13133d None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.868747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6407f46-e5a5-4876-97df-e2947f13133d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:42.870647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6407f46-e5a5-4876-97df-e2947f13133d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:42.879877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 447/904] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 12:44:42 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:44:42.891727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c792d-6e99-4891-afc0-cda677babdc9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:42.970963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975c26-87ff-4609-9183-39802bb67f3d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.971158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975c26-87ff-4609-9183-39802bb67f3d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.971433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975c26-87ff-4609-9183-39802bb67f3d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.972969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 448/905] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:42.979313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad853-8e3a-4ea9-af69-072ddeca104e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:42.979587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad853-8e3a-4ea9-af69-072ddeca104e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:42.979929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad853-8e3a-4ea9-af69-072ddeca104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:42.998938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f2cad853-8e3a-4ea9-af69-072ddeca104e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:43.000272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f2cad853-8e3a-4ea9-af69-072ddeca104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:43.020512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:43.075641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c792d-6e99-4891-afc0-cda677babdc9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:43.094205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 449/906] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:44:43.114869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cad853-8e3a-4ea9-af69-072ddeca104e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:43.123437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:43.130727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690df081-a9bc-41a8-be2e-579d117c643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:43.131578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690df081-a9bc-41a8-be2e-579d117c643c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:43.132131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690df081-a9bc-41a8-be2e-579d117c643c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:43.132424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690df081-a9bc-41a8-be2e-579d117c643c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:43.133421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690df081-a9bc-41a8-be2e-579d117c643c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:43.136598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690df081-a9bc-41a8-be2e-579d117c643c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-690df081-a9bc-41a8-be2e-579d117c643c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:43.152420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:43.153687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:43.154751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 458/907] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:44:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:43.160924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690df081-a9bc-41a8-be2e-579d117c643c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:43.264698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cad853-8e3a-4ea9-af69-072ddeca104e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:43.314081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690df081-a9bc-41a8-be2e-579d117c643c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:43.326183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143b876-459b-4412-b883-bffa8ddf368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:43.327360 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143b876-459b-4412-b883-bffa8ddf368d None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:43.327874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143b876-459b-4412-b883-bffa8ddf368d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:43.328458 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143b876-459b-4412-b883-bffa8ddf368d None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:43.329671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143b876-459b-4412-b883-bffa8ddf368d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:43.331480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143b876-459b-4412-b883-bffa8ddf368d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:43.362255 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 450/908] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:44:43 2022] POST /identity/v3/services => generated 241 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:44:43.375317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a8718-bf02-4f01-bc65-b32c18b92d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:43.376161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a8718-bf02-4f01-bc65-b32c18b92d3c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:43.376495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a8718-bf02-4f01-bc65-b32c18b92d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:43.376778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a8718-bf02-4f01-bc65-b32c18b92d3c None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:43.377771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a8718-bf02-4f01-bc65-b32c18b92d3c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:43.378393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a8718-bf02-4f01-bc65-b32c18b92d3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:43.381211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a8718-bf02-4f01-bc65-b32c18b92d3c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:43.392808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 459/909] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:44:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:43.399502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143b876-459b-4412-b883-bffa8ddf368d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:43.420793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:43.572578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143b876-459b-4412-b883-bffa8ddf368d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:43.628288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cddfd2-2221-4e6b-acb5-c3a2508e92bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:43.629003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cddfd2-2221-4e6b-acb5-c3a2508e92bb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:43.629293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cddfd2-2221-4e6b-acb5-c3a2508e92bb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:43.629570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cddfd2-2221-4e6b-acb5-c3a2508e92bb None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:43.630446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cddfd2-2221-4e6b-acb5-c3a2508e92bb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:43.630758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cddfd2-2221-4e6b-acb5-c3a2508e92bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:43.632206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cddfd2-2221-4e6b-acb5-c3a2508e92bb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:43.638391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 451/910] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:44:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:43.644475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a8718-bf02-4f01-bc65-b32c18b92d3c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:43.706895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:43.760360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a8718-bf02-4f01-bc65-b32c18b92d3c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:43.800716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fe79e-615d-4aab-9aa4-e0e02e00f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:43.801806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe79e-615d-4aab-9aa4-e0e02e00f998 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:43.802321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe79e-615d-4aab-9aa4-e0e02e00f998 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:43.802789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe79e-615d-4aab-9aa4-e0e02e00f998 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:43.803772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fe79e-615d-4aab-9aa4-e0e02e00f998 None admin] RBAC: Adding query filter params (interface=public, service_id=658df10e9836474d83aae8f927ab340e, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:43.804333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fe79e-615d-4aab-9aa4-e0e02e00f998 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:43.805964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fe79e-615d-4aab-9aa4-e0e02e00f998 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:43.812598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 460/911] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 12:44:43 2022] GET /identity/v3/endpoints?service_id=658df10e9836474d83aae8f927ab340e&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:43.818676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cddfd2-2221-4e6b-acb5-c3a2508e92bb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:43.908834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:43.932844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cddfd2-2221-4e6b-acb5-c3a2508e92bb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:43.969036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43859bb7-aae8-4b25-9dd3-846458fecf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:43.969742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859bb7-aae8-4b25-9dd3-846458fecf02 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:43.970025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859bb7-aae8-4b25-9dd3-846458fecf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:43.970333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859bb7-aae8-4b25-9dd3-846458fecf02 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:43.971030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43859bb7-aae8-4b25-9dd3-846458fecf02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:43.972473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43859bb7-aae8-4b25-9dd3-846458fecf02 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:43.986253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 452/912] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 12:44:43 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:44:45.001358 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d5a0-b643-4ee7-b06e-8e0b6d369906 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:45.002218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d5a0-b643-4ee7-b06e-8e0b6d369906 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:45.002218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d5a0-b643-4ee7-b06e-8e0b6d369906 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:45.003648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 461/913] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:45.012842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4561468-b359-4004-b9bd-99f9f956924d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:45.014302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4561468-b359-4004-b9bd-99f9f956924d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:45.015086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4561468-b359-4004-b9bd-99f9f956924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:45.037898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b4561468-b359-4004-b9bd-99f9f956924d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:45.039187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b4561468-b359-4004-b9bd-99f9f956924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:45.121096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 453/914] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:45.158799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d5a0-b643-4ee7-b06e-8e0b6d369906 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:45.286235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d5a0-b643-4ee7-b06e-8e0b6d369906 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:45.318323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:45.345306 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203b6e7-2013-48aa-b523-a7605e1b545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:45.346608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203b6e7-2013-48aa-b523-a7605e1b545f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:45.346930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203b6e7-2013-48aa-b523-a7605e1b545f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:45.347207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203b6e7-2013-48aa-b523-a7605e1b545f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:45.364197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203b6e7-2013-48aa-b523-a7605e1b545f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d203b6e7-2013-48aa-b523-a7605e1b545f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:45.376741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:45.378257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:45.380188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 462/915] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 12:44:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:45.393259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4561468-b359-4004-b9bd-99f9f956924d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:45.534514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:45.554307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4561468-b359-4004-b9bd-99f9f956924d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:45.593427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69da4b-7a99-4fcb-985e-56cd1ee2cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:45.594607 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69da4b-7a99-4fcb-985e-56cd1ee2cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:45.595104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69da4b-7a99-4fcb-985e-56cd1ee2cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:45.595592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69da4b-7a99-4fcb-985e-56cd1ee2cbc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:45.596845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69da4b-7a99-4fcb-985e-56cd1ee2cbc6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:45.597165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69da4b-7a99-4fcb-985e-56cd1ee2cbc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:45.598726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69da4b-7a99-4fcb-985e-56cd1ee2cbc6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:45.609448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 454/916] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 12:44:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:45.618604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203b6e7-2013-48aa-b523-a7605e1b545f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:45.760736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203b6e7-2013-48aa-b523-a7605e1b545f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:45.802525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e7d58-81fc-4d18-8252-bb4cfdcbddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:45.803643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e7d58-81fc-4d18-8252-bb4cfdcbddf0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:45.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e7d58-81fc-4d18-8252-bb4cfdcbddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:45.804574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e7d58-81fc-4d18-8252-bb4cfdcbddf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:45.817009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e7d58-81fc-4d18-8252-bb4cfdcbddf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:45.818995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e7d58-81fc-4d18-8252-bb4cfdcbddf0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-654e7d58-81fc-4d18-8252-bb4cfdcbddf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:45.839230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:45.840402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:45.841547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:45.841547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:45.841547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:45.841547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:45.843518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 463/917] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:45.852189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69da4b-7a99-4fcb-985e-56cd1ee2cbc6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:45.864431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffef647-3c03-4b8e-ab0f-fec2cd668164 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:45.864942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffef647-3c03-4b8e-ab0f-fec2cd668164 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:45.865241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffef647-3c03-4b8e-ab0f-fec2cd668164 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:45.866884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 464/918] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:45.872247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0587960-efdd-4de8-a2c4-284bd18d1570 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:45.872539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0587960-efdd-4de8-a2c4-284bd18d1570 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:45.872814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0587960-efdd-4de8-a2c4-284bd18d1570 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:45.874166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 465/919] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:45.875385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4e7d-0786-422b-a00b-a3f7fd4c5cea None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:45.875676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4e7d-0786-422b-a00b-a3f7fd4c5cea None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:45.875950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4e7d-0786-422b-a00b-a3f7fd4c5cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:45.895345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-55bf4e7d-0786-422b-a00b-a3f7fd4c5cea None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:45.896626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-55bf4e7d-0786-422b-a00b-a3f7fd4c5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:45.928264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:45.975106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69da4b-7a99-4fcb-985e-56cd1ee2cbc6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:45.980524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 466/920] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:45.983591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc66b34-f8f0-461d-82d2-3ef42f435eb7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:45.983886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc66b34-f8f0-461d-82d2-3ef42f435eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:45.984165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc66b34-f8f0-461d-82d2-3ef42f435eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.006384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-abc66b34-f8f0-461d-82d2-3ef42f435eb7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:46.007597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-abc66b34-f8f0-461d-82d2-3ef42f435eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:46.014939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a1c4-1b39-43c9-b43a-dd62b3a19ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:46.015630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a1c4-1b39-43c9-b43a-dd62b3a19ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.015912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a1c4-1b39-43c9-b43a-dd62b3a19ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.016186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a1c4-1b39-43c9-b43a-dd62b3a19ad4 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.016913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301a1c4-1b39-43c9-b43a-dd62b3a19ad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:46.017221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301a1c4-1b39-43c9-b43a-dd62b3a19ad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:46.018665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301a1c4-1b39-43c9-b43a-dd62b3a19ad4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:46.020330 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:46.032612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 455/921] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:46.033576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a1c4-1b39-43c9-b43a-dd62b3a19ad4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.095611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 467/922] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:46.096793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc66b34-f8f0-461d-82d2-3ef42f435eb7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.151544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a1c4-1b39-43c9-b43a-dd62b3a19ad4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:46.192240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81824d1-890e-4a96-abfc-47a720475aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:46.194167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81824d1-890e-4a96-abfc-47a720475aba None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.194643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81824d1-890e-4a96-abfc-47a720475aba None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.195089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81824d1-890e-4a96-abfc-47a720475aba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.196078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81824d1-890e-4a96-abfc-47a720475aba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:46.198333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81824d1-890e-4a96-abfc-47a720475aba None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:46.205521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b81824d1-890e-4a96-abfc-47a720475aba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:46.212646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:46.213677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:46.219197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 456/923] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:46.219993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81824d1-890e-4a96-abfc-47a720475aba None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.225983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc66b34-f8f0-461d-82d2-3ef42f435eb7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:46.264856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b8af-7568-4901-8879-a865d54740ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:46.265722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b8af-7568-4901-8879-a865d54740ef None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.266072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b8af-7568-4901-8879-a865d54740ef None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.266438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b8af-7568-4901-8879-a865d54740ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.275402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533b8af-7568-4901-8879-a865d54740ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:46.277025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533b8af-7568-4901-8879-a865d54740ef None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:46.282344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b533b8af-7568-4901-8879-a865d54740ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:46.295057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:46.296087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:46.297030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 468/924] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:46.297617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b8af-7568-4901-8879-a865d54740ef None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.338429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81824d1-890e-4a96-abfc-47a720475aba None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:46.382618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8d4bc-986a-409c-9ab6-ca8bd868bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:46.383527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8d4bc-986a-409c-9ab6-ca8bd868bc11 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.383835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8d4bc-986a-409c-9ab6-ca8bd868bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.384109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8d4bc-986a-409c-9ab6-ca8bd868bc11 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.384977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8d4bc-986a-409c-9ab6-ca8bd868bc11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:46.387638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8d4bc-986a-409c-9ab6-ca8bd868bc11 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7be8d4bc-986a-409c-9ab6-ca8bd868bc11 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:46.410815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:46.412044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 12:44:46.412903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:46.413681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 457/925] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:46.415125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8d4bc-986a-409c-9ab6-ca8bd868bc11 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.438436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b8af-7568-4901-8879-a865d54740ef None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:46.496555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a376597-e9e4-4b02-a730-fe777f0c6074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:46.497241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a376597-e9e4-4b02-a730-fe777f0c6074 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.497523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a376597-e9e4-4b02-a730-fe777f0c6074 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.497800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a376597-e9e4-4b02-a730-fe777f0c6074 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.498552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a376597-e9e4-4b02-a730-fe777f0c6074 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:46.498860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a376597-e9e4-4b02-a730-fe777f0c6074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:46.500297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a376597-e9e4-4b02-a730-fe777f0c6074 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:46.505848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 469/926] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:46.506790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a376597-e9e4-4b02-a730-fe777f0c6074 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.524137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:46.548659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8d4bc-986a-409c-9ab6-ca8bd868bc11 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:46.573522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:46.585993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09504b54-f56c-4505-8865-3670308f8f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:46.586714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504b54-f56c-4505-8865-3670308f8f64 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.586998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504b54-f56c-4505-8865-3670308f8f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.587349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09504b54-f56c-4505-8865-3670308f8f64 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.588145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09504b54-f56c-4505-8865-3670308f8f64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:46.588459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09504b54-f56c-4505-8865-3670308f8f64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:46.589942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09504b54-f56c-4505-8865-3670308f8f64 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:46.609199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 458/927] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:46.610606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0412dd1-9041-4b3b-98f2-6471cb3dcd3f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.610865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0412dd1-9041-4b3b-98f2-6471cb3dcd3f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.611142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0412dd1-9041-4b3b-98f2-6471cb3dcd3f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.612398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 459/928] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:46.613438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0412dd1-9041-4b3b-98f2-6471cb3dcd3f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.618996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a376597-e9e4-4b02-a730-fe777f0c6074 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:46.655779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d029e-2b98-41ea-8733-63afbacbee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:46.656374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d029e-2b98-41ea-8733-63afbacbee20 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.656657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d029e-2b98-41ea-8733-63afbacbee20 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.657461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d029e-2b98-41ea-8733-63afbacbee20 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.657712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d029e-2b98-41ea-8733-63afbacbee20 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:46.657931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d029e-2b98-41ea-8733-63afbacbee20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:46.659388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d029e-2b98-41ea-8733-63afbacbee20 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:46.665099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 470/929] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:46.665905 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d029e-2b98-41ea-8733-63afbacbee20 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.728861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0412dd1-9041-4b3b-98f2-6471cb3dcd3f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:46.749239 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:46.768064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2e4e2-c993-41c2-800e-1c7b3b1296e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:46.768757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2e4e2-c993-41c2-800e-1c7b3b1296e7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.769043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2e4e2-c993-41c2-800e-1c7b3b1296e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.769320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2e4e2-c993-41c2-800e-1c7b3b1296e7 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.770159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2e4e2-c993-41c2-800e-1c7b3b1296e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:46.770409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2e4e2-c993-41c2-800e-1c7b3b1296e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:46.772663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2e4e2-c993-41c2-800e-1c7b3b1296e7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:46.774248 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d029e-2b98-41ea-8733-63afbacbee20 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:46.777884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 460/930] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:46.779177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999c836-788d-481d-87c5-51618e34b0e3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.779564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999c836-788d-481d-87c5-51618e34b0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.779741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999c836-788d-481d-87c5-51618e34b0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.797181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4999c836-788d-481d-87c5-51618e34b0e3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:46.798539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4999c836-788d-481d-87c5-51618e34b0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:46.811762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e41aaf-aa23-4700-9729-8c4920e25240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:46.812635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e41aaf-aa23-4700-9729-8c4920e25240 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:46.812885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e41aaf-aa23-4700-9729-8c4920e25240 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:46.813157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e41aaf-aa23-4700-9729-8c4920e25240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:46.824336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e41aaf-aa23-4700-9729-8c4920e25240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:46.825848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e41aaf-aa23-4700-9729-8c4920e25240 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:46.843152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-45e41aaf-aa23-4700-9729-8c4920e25240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:46.846015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:46.847026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:46.847911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:46.847911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:46.847911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:46.847911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:46.847911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 471/931] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:46.848937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e41aaf-aa23-4700-9729-8c4920e25240 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.877142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 461/932] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:46.878007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999c836-788d-481d-87c5-51618e34b0e3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:46.973308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e41aaf-aa23-4700-9729-8c4920e25240 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:46.984813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999c836-788d-481d-87c5-51618e34b0e3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:47.005908 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:47.013784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2bf59-69d4-471c-95de-143dd703f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.014517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2bf59-69d4-471c-95de-143dd703f03f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.014799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2bf59-69d4-471c-95de-143dd703f03f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.015078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2bf59-69d4-471c-95de-143dd703f03f None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.015798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2bf59-69d4-471c-95de-143dd703f03f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:47.016126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2bf59-69d4-471c-95de-143dd703f03f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.017599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2bf59-69d4-471c-95de-143dd703f03f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.023223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 472/933] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:47.024045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2bf59-69d4-471c-95de-143dd703f03f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.030030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0048b-0254-4c64-801d-bc13b006e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.030764 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0048b-0254-4c64-801d-bc13b006e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.031042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0048b-0254-4c64-801d-bc13b006e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.031311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0048b-0254-4c64-801d-bc13b006e1d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.032145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0048b-0254-4c64-801d-bc13b006e1d8 None admin] RBAC: Adding query filter params (interface=public, service_id=4cd8a6e5f3bb4a0c8b87404987ad68bf, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:47.032473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0048b-0254-4c64-801d-bc13b006e1d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.033888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0048b-0254-4c64-801d-bc13b006e1d8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.042397 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 462/934] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 12:44:46 2022] GET /identity/v3/endpoints?service_id=4cd8a6e5f3bb4a0c8b87404987ad68bf&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:47.043478 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0048b-0254-4c64-801d-bc13b006e1d8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.087809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:47.141328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2bf59-69d4-471c-95de-143dd703f03f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:47.151469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0048b-0254-4c64-801d-bc13b006e1d8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:47.177116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ecd12-6bf2-4fa0-a10d-5e58022053a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.177806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ecd12-6bf2-4fa0-a10d-5e58022053a8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.178110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ecd12-6bf2-4fa0-a10d-5e58022053a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.178395 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ecd12-6bf2-4fa0-a10d-5e58022053a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.179159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ecd12-6bf2-4fa0-a10d-5e58022053a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:47.179467 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ecd12-6bf2-4fa0-a10d-5e58022053a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.180901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ecd12-6bf2-4fa0-a10d-5e58022053a8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.187926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ad5e-a43e-4547-85ce-db17fcc003f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.188766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ad5e-a43e-4547-85ce-db17fcc003f6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.189050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ad5e-a43e-4547-85ce-db17fcc003f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.189328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ad5e-a43e-4547-85ce-db17fcc003f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.189995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355ad5e-a43e-4547-85ce-db17fcc003f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.191421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355ad5e-a43e-4547-85ce-db17fcc003f6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.193227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 473/935] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:47.193951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ecd12-6bf2-4fa0-a10d-5e58022053a8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-1355ad5e-a43e-4547-85ce-db17fcc003f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:47.209538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:47.210917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:47.212238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 463/936] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:44:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:47.213061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ad5e-a43e-4547-85ce-db17fcc003f6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.256769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:47.307656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ecd12-6bf2-4fa0-a10d-5e58022053a8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:47.324648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ad5e-a43e-4547-85ce-db17fcc003f6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:47.326326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:47.346933 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773370cb-5928-4bc6-9c17-654c64b6969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.347616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773370cb-5928-4bc6-9c17-654c64b6969e None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.347897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773370cb-5928-4bc6-9c17-654c64b6969e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.348172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773370cb-5928-4bc6-9c17-654c64b6969e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.349075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773370cb-5928-4bc6-9c17-654c64b6969e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.350657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773370cb-5928-4bc6-9c17-654c64b6969e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.371889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 474/937] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 12:44:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:44:47.372750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773370cb-5928-4bc6-9c17-654c64b6969e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.394695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77b646-58b2-4065-a9bb-8799a99af922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.395422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77b646-58b2-4065-a9bb-8799a99af922 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.395720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77b646-58b2-4065-a9bb-8799a99af922 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.395989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77b646-58b2-4065-a9bb-8799a99af922 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.396855 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77b646-58b2-4065-a9bb-8799a99af922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.398322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77b646-58b2-4065-a9bb-8799a99af922 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.405857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 464/938] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 12:44:47 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:44:47.406484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77b646-58b2-4065-a9bb-8799a99af922 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.567564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773370cb-5928-4bc6-9c17-654c64b6969e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:47.570246 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77b646-58b2-4065-a9bb-8799a99af922 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:47.583622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:47.629118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475246-ca13-4703-b058-a6e526c404bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.629494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e851-c156-40c3-a17a-dc66f2900330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.629610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475246-ca13-4703-b058-a6e526c404bf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.629922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475246-ca13-4703-b058-a6e526c404bf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.630515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475246-ca13-4703-b058-a6e526c404bf None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.631685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e851-c156-40c3-a17a-dc66f2900330 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.631793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475246-ca13-4703-b058-a6e526c404bf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:47.631867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e851-c156-40c3-a17a-dc66f2900330 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.631936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475246-ca13-4703-b058-a6e526c404bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.632004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e851-c156-40c3-a17a-dc66f2900330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.632986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475246-ca13-4703-b058-a6e526c404bf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.641060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 465/939] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:44:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:47.641244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23e851-c156-40c3-a17a-dc66f2900330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.641710 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23e851-c156-40c3-a17a-dc66f2900330 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.651214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475246-ca13-4703-b058-a6e526c404bf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3f23e851-c156-40c3-a17a-dc66f2900330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:47.657992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:47.659008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:47.660371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:47.660371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:47.660371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:47.660371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:47.660371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:47.660371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:47.660371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:47.660371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:47.660371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 475/940] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:47.665952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e851-c156-40c3-a17a-dc66f2900330 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.692151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:47.810633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475246-ca13-4703-b058-a6e526c404bf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:47.814892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e851-c156-40c3-a17a-dc66f2900330 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:47.851988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b5b68-d095-4989-bfe4-08129f081d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.853184 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b5b68-d095-4989-bfe4-08129f081d07 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.853675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b5b68-d095-4989-bfe4-08129f081d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.854210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b5b68-d095-4989-bfe4-08129f081d07 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.855163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b5b68-d095-4989-bfe4-08129f081d07 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:47.855681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b5b68-d095-4989-bfe4-08129f081d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.857406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b5b68-d095-4989-bfe4-08129f081d07 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.865031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 466/941] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 17 12:44:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:47.871450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b5b68-d095-4989-bfe4-08129f081d07 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.875550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fccb31-0114-43fb-9ca6-30a3e5b87184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:47.876580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fccb31-0114-43fb-9ca6-30a3e5b87184 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:47.877122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fccb31-0114-43fb-9ca6-30a3e5b87184 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:47.877617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fccb31-0114-43fb-9ca6-30a3e5b87184 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:47.878793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fccb31-0114-43fb-9ca6-30a3e5b87184 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:47.879305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fccb31-0114-43fb-9ca6-30a3e5b87184 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:47.881801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fccb31-0114-43fb-9ca6-30a3e5b87184 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:47.898460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 476/942] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:47.907363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fccb31-0114-43fb-9ca6-30a3e5b87184 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:47.940358 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:47.995651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:48.008508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b5b68-d095-4989-bfe4-08129f081d07 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:48.026590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fccb31-0114-43fb-9ca6-30a3e5b87184 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:48.062011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd25732-fb2b-4ebc-bdac-f55a30acd702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:48.062756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd25732-fb2b-4ebc-bdac-f55a30acd702 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:48.063065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd25732-fb2b-4ebc-bdac-f55a30acd702 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:48.063340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd25732-fb2b-4ebc-bdac-f55a30acd702 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:48.064529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd25732-fb2b-4ebc-bdac-f55a30acd702 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:48.066338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd25732-fb2b-4ebc-bdac-f55a30acd702 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:48.070658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24e931-d6d2-47b1-9942-80d9cff826fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:48.072002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e931-d6d2-47b1-9942-80d9cff826fd None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:48.072492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e931-d6d2-47b1-9942-80d9cff826fd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:48.072958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e931-d6d2-47b1-9942-80d9cff826fd None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/3b34545615e447329344a942cd31c12a/roles/aa601cdd14964e958fd1ee007671e7f9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:48.075811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24e931-d6d2-47b1-9942-80d9cff826fd None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=3b34545615e447329344a942cd31c12a, role_id=aa601cdd14964e958fd1ee007671e7f9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:48.078591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24e931-d6d2-47b1-9942-80d9cff826fd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:48.097914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 467/943] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 12:44:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:44:48.103172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 477/944] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:44:47 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/3b34545615e447329344a942cd31c12a/roles/aa601cdd14964e958fd1ee007671e7f9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:44:49.654030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6ab5-dc1d-40b1-8adb-cd99cc1fbfaf None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:49.654591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6ab5-dc1d-40b1-8adb-cd99cc1fbfaf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:49.654591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6ab5-dc1d-40b1-8adb-cd99cc1fbfaf None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:49.656271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 468/945] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:49.662201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69d989-d29e-4fc5-b313-caacadd66f98 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:49.662740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69d989-d29e-4fc5-b313-caacadd66f98 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:49.662740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69d989-d29e-4fc5-b313-caacadd66f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:49.680723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7e69d989-d29e-4fc5-b313-caacadd66f98 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:49.681907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7e69d989-d29e-4fc5-b313-caacadd66f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:49.763351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 478/946] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:44:49.786306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd6ab5-dc1d-40b1-8adb-cd99cc1fbfaf None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:49.825064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11479597-d9d2-41e8-83a7-a36d686f3271 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:49.825408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11479597-d9d2-41e8-83a7-a36d686f3271 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:49.825617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11479597-d9d2-41e8-83a7-a36d686f3271 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:49.827260 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 479/947] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:49.834813 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ea2fb-34da-4c35-bcf6-e0193d707e8d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:49.835322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ea2fb-34da-4c35-bcf6-e0193d707e8d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:49.835748 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ea2fb-34da-4c35-bcf6-e0193d707e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:49.858719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ce8ea2fb-34da-4c35-bcf6-e0193d707e8d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:49.860485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ce8ea2fb-34da-4c35-bcf6-e0193d707e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:49.890555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:49.918043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd6ab5-dc1d-40b1-8adb-cd99cc1fbfaf None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:49.964826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5d56-3d30-4f49-92e4-ecc3c0fd9000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:49.966148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 480/948] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:44:49.970358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5d56-3d30-4f49-92e4-ecc3c0fd9000 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:49.970947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5d56-3d30-4f49-92e4-ecc3c0fd9000 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:49.971429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5d56-3d30-4f49-92e4-ecc3c0fd9000 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:49.972333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5d56-3d30-4f49-92e4-ecc3c0fd9000 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:49.974529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5d56-3d30-4f49-92e4-ecc3c0fd9000 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e8fb5d56-3d30-4f49-92e4-ecc3c0fd9000 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:49.987975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:49.989440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 12:44:49.990297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:49.991818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 469/949] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:49.994156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ea2fb-34da-4c35-bcf6-e0193d707e8d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:49.999005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5d56-3d30-4f49-92e4-ecc3c0fd9000 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:50.014979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:50.138117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ea2fb-34da-4c35-bcf6-e0193d707e8d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:50.170344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5d56-3d30-4f49-92e4-ecc3c0fd9000 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:50.194037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d9574-7b90-4945-8e8f-46120279b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:50.195023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d9574-7b90-4945-8e8f-46120279b72a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.195380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d9574-7b90-4945-8e8f-46120279b72a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.195823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d9574-7b90-4945-8e8f-46120279b72a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.196495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d9574-7b90-4945-8e8f-46120279b72a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:50.198004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d9574-7b90-4945-8e8f-46120279b72a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:50.211720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b5cdd-72c5-4800-981d-73989ee1b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-dd4d9574-7b90-4945-8e8f-46120279b72a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:50.212454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:50.213795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:50.215107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:50.216325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b5cdd-72c5-4800-981d-73989ee1b299 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.216773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b5cdd-72c5-4800-981d-73989ee1b299 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.217192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b5cdd-72c5-4800-981d-73989ee1b299 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.218076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b5cdd-72c5-4800-981d-73989ee1b299 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:50.218551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b5cdd-72c5-4800-981d-73989ee1b299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:50.220506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 481/950] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:50.220777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b5cdd-72c5-4800-981d-73989ee1b299 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:50.221453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d9574-7b90-4945-8e8f-46120279b72a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:50.229493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 470/951] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:50.235989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b5cdd-72c5-4800-981d-73989ee1b299 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:50.242443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:50.357960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:50.391713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b5cdd-72c5-4800-981d-73989ee1b299 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:50.392608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d9574-7b90-4945-8e8f-46120279b72a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:50.426901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4cf28-b42b-452f-b5ad-f046b1312007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:50.427557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4cf28-b42b-452f-b5ad-f046b1312007 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.427862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4cf28-b42b-452f-b5ad-f046b1312007 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.428138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4cf28-b42b-452f-b5ad-f046b1312007 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.428921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4cf28-b42b-452f-b5ad-f046b1312007 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:50.429233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4cf28-b42b-452f-b5ad-f046b1312007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:50.430453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee381e-8ea6-4ca5-a675-9a801f20bef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:50.430590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4cf28-b42b-452f-b5ad-f046b1312007 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:50.431129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee381e-8ea6-4ca5-a675-9a801f20bef1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.431408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee381e-8ea6-4ca5-a675-9a801f20bef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.431682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee381e-8ea6-4ca5-a675-9a801f20bef1 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.432430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee381e-8ea6-4ca5-a675-9a801f20bef1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:50.432730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee381e-8ea6-4ca5-a675-9a801f20bef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:50.434145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee381e-8ea6-4ca5-a675-9a801f20bef1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:50.435641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 471/952] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:50.436923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ed37-0895-456a-a481-058df662dca6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.437211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ed37-0895-456a-a481-058df662dca6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.437483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ed37-0895-456a-a481-058df662dca6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.438802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 472/953] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:50.439918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e00e-b15f-45e5-8ee2-e8d2dd3acb05 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.440186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e00e-b15f-45e5-8ee2-e8d2dd3acb05 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.440460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e00e-b15f-45e5-8ee2-e8d2dd3acb05 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.446120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 473/954] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:50.446444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a10e-7d82-406b-94dd-1b843369509a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.446706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a10e-7d82-406b-94dd-1b843369509a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.446974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a10e-7d82-406b-94dd-1b843369509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.450333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 482/955] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:50.451520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e6c4-ad5b-4686-be4f-b00fef64c90e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.451798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e6c4-ad5b-4686-be4f-b00fef64c90e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.452073 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5e6c4-ad5b-4686-be4f-b00fef64c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.471888 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d3f5e6c4-ad5b-4686-be4f-b00fef64c90e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:50.472396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4da8a10e-7d82-406b-94dd-1b843369509a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:50.473109 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d3f5e6c4-ad5b-4686-be4f-b00fef64c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:50.473573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4da8a10e-7d82-406b-94dd-1b843369509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:50.556085 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 483/956] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:50.557370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e6c4-ad5b-4686-be4f-b00fef64c90e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:50.568322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:50.583428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 474/957] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:50.586639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a10e-7d82-406b-94dd-1b843369509a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:50.670810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:50.686251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5e6c4-ad5b-4686-be4f-b00fef64c90e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:50.720980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a10e-7d82-406b-94dd-1b843369509a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:50.730562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6b44a-3a56-48db-a4bc-fd820af75eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:50.731259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6b44a-3a56-48db-a4bc-fd820af75eec None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.731538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6b44a-3a56-48db-a4bc-fd820af75eec None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.731815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6b44a-3a56-48db-a4bc-fd820af75eec None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.732527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6b44a-3a56-48db-a4bc-fd820af75eec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:50.732831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6b44a-3a56-48db-a4bc-fd820af75eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:50.734366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6b44a-3a56-48db-a4bc-fd820af75eec None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:50.740634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 484/958] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:50.743086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6b44a-3a56-48db-a4bc-fd820af75eec None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:50.772361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:50.774502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.775016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.775849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.777396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:50.780526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:50.783386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING keystone.server.flask.common [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 17 12:44:50.814984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 12:44:50.814984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 12:44:50.814984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [parameters: {'id': 'a9c281d3ff4e4ec5aab6981947b8e019', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 12:44:50.814984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9c281d3ff4e4ec5aab6981947b8e019.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9c281d3ff4e4ec5aab6981947b8e019. Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 12:44:50.822902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 17 12:44:50.823922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() Jun 17 12:44:50.825025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 12:44:50.826708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 12:44:50.828080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 12:44:50.829370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'id': 'a9c281d3ff4e4ec5aab6981947b8e019', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:50.830920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:50.831930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:50.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:50.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 17 12:44:50.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 17 12:44:50.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:50.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:50.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 17 12:44:50.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 17 12:44:50.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9c281d3ff4e4ec5aab6981947b8e019. Jun 17 12:44:50.833665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:50.836264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:50.836370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 475/959] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Jun 17 12:44:50 2022] POST /identity/v3/projects => generated 262 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:50.836370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:50.881488 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6b44a-3a56-48db-a4bc-fd820af75eec None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:50.924906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa10ac-ec68-4765-9582-d7385385bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:50.926069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa10ac-ec68-4765-9582-d7385385bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:50.926391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa10ac-ec68-4765-9582-d7385385bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:50.926679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa10ac-ec68-4765-9582-d7385385bbd5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:50.939952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa10ac-ec68-4765-9582-d7385385bbd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-86fa10ac-ec68-4765-9582-d7385385bbd5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:44:50.949628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:50.951036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:44:50.952168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:50.953260 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 485/960] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 12:44:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:50.954506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa10ac-ec68-4765-9582-d7385385bbd5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:50.968842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3fc7-a270-4abd-b694-60c89d4e17d5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:50.999661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:51.015442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9868e-7a6c-4b3b-8536-93c2b34fb531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:51.016140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9868e-7a6c-4b3b-8536-93c2b34fb531 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:51.016434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9868e-7a6c-4b3b-8536-93c2b34fb531 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:51.016715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9868e-7a6c-4b3b-8536-93c2b34fb531 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:51.018017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9868e-7a6c-4b3b-8536-93c2b34fb531 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:51.019466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9868e-7a6c-4b3b-8536-93c2b34fb531 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:51.063005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 476/961] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 12:44:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:44:51.063005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9868e-7a6c-4b3b-8536-93c2b34fb531 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:51.099177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa10ac-ec68-4765-9582-d7385385bbd5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:51.145731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:51.165608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a940cd2-5a84-432c-bed3-bede0d5554e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:51.166713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a940cd2-5a84-432c-bed3-bede0d5554e7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:51.167080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a940cd2-5a84-432c-bed3-bede0d5554e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:51.167486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a940cd2-5a84-432c-bed3-bede0d5554e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:51.177774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a940cd2-5a84-432c-bed3-bede0d5554e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:51.180497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a940cd2-5a84-432c-bed3-bede0d5554e7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0a940cd2-5a84-432c-bed3-bede0d5554e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:51.213482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:51.214463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:51.215361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:51.215361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:51.215361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:51.215361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:51.215361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:51.215361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:51.215361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:51.215361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:51.222350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 486/962] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:51.223430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a940cd2-5a84-432c-bed3-bede0d5554e7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:51.248848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9868e-7a6c-4b3b-8536-93c2b34fb531 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:51.294224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6217c-87f7-4ddc-b534-f5da4f3fab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:51.294937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6217c-87f7-4ddc-b534-f5da4f3fab3b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:51.295224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6217c-87f7-4ddc-b534-f5da4f3fab3b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:51.295496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6217c-87f7-4ddc-b534-f5da4f3fab3b None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:51.296276 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6217c-87f7-4ddc-b534-f5da4f3fab3b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:51.296586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6217c-87f7-4ddc-b534-f5da4f3fab3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:51.298011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6217c-87f7-4ddc-b534-f5da4f3fab3b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:51.313747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 477/963] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 12:44:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:51.320708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6217c-87f7-4ddc-b534-f5da4f3fab3b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:51.389759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a940cd2-5a84-432c-bed3-bede0d5554e7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:51.390448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:51.429010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64984335-e516-4a7d-b1ec-762e3d9165f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:51.429688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64984335-e516-4a7d-b1ec-762e3d9165f8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:51.429966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64984335-e516-4a7d-b1ec-762e3d9165f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:51.430271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64984335-e516-4a7d-b1ec-762e3d9165f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:51.431483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64984335-e516-4a7d-b1ec-762e3d9165f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:51.431483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64984335-e516-4a7d-b1ec-762e3d9165f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:51.432892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64984335-e516-4a7d-b1ec-762e3d9165f8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:51.458463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 487/964] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:51.475013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6217c-87f7-4ddc-b534-f5da4f3fab3b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:51.517609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d526e-49bc-491d-ac95-7a850ce48690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:51.518886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d526e-49bc-491d-ac95-7a850ce48690 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:51.519423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d526e-49bc-491d-ac95-7a850ce48690 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:51.519925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d526e-49bc-491d-ac95-7a850ce48690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:51.533121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d526e-49bc-491d-ac95-7a850ce48690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:51.535126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d526e-49bc-491d-ac95-7a850ce48690 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ad5d526e-49bc-491d-ac95-7a850ce48690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:51.556002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:51.557008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:51.557913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:51.557913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:51.557913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:51.557913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:51.560669 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 478/965] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:51.566453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64984335-e516-4a7d-b1ec-762e3d9165f8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:51.629077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:51.705911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64984335-e516-4a7d-b1ec-762e3d9165f8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:51.746614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3357983-134b-4121-8334-989d7045c2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:51.747229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3357983-134b-4121-8334-989d7045c2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:51.747513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3357983-134b-4121-8334-989d7045c2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:51.747789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3357983-134b-4121-8334-989d7045c2d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:51.748521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3357983-134b-4121-8334-989d7045c2d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:51.748828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3357983-134b-4121-8334-989d7045c2d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:51.750295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3357983-134b-4121-8334-989d7045c2d2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:51.765056 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 488/966] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:51.772871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d526e-49bc-491d-ac95-7a850ce48690 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:51.878475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:51.883877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d526e-49bc-491d-ac95-7a850ce48690 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:51.923388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e843c-88c2-4d1b-af4a-ec54f07573c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:51.924292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e843c-88c2-4d1b-af4a-ec54f07573c4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:51.924581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e843c-88c2-4d1b-af4a-ec54f07573c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:51.924860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e843c-88c2-4d1b-af4a-ec54f07573c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:51.933412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e843c-88c2-4d1b-af4a-ec54f07573c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:51.934989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e843c-88c2-4d1b-af4a-ec54f07573c4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-641e843c-88c2-4d1b-af4a-ec54f07573c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:51.952249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:51.953285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:51.954701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 479/967] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:44:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:51.960000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3357983-134b-4121-8334-989d7045c2d2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:52.067078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3357983-134b-4121-8334-989d7045c2d2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:52.069511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:52.105361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb45c2-6a13-46f0-810a-c2c9ffb7aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:52.106575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb45c2-6a13-46f0-810a-c2c9ffb7aaea None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:52.107080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb45c2-6a13-46f0-810a-c2c9ffb7aaea None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:52.107653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb45c2-6a13-46f0-810a-c2c9ffb7aaea None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:52.108692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb45c2-6a13-46f0-810a-c2c9ffb7aaea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:52.109202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb45c2-6a13-46f0-810a-c2c9ffb7aaea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:52.110918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb45c2-6a13-46f0-810a-c2c9ffb7aaea None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:52.131707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 489/968] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 17 12:44:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:52.141725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e843c-88c2-4d1b-af4a-ec54f07573c4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:52.245227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e843c-88c2-4d1b-af4a-ec54f07573c4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:52.283789 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9c569-97dd-4953-92bb-92c47aeee7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:52.284708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9c569-97dd-4953-92bb-92c47aeee7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:52.285127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9c569-97dd-4953-92bb-92c47aeee7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:52.285564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9c569-97dd-4953-92bb-92c47aeee7b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:52.322611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:52.364682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9c569-97dd-4953-92bb-92c47aeee7b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:52.366178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9c569-97dd-4953-92bb-92c47aeee7b3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:52.469905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 480/969] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:44:52 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:44:52.475864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb45c2-6a13-46f0-810a-c2c9ffb7aaea None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:52.598325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb45c2-6a13-46f0-810a-c2c9ffb7aaea None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:52.637307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49135b-fbc2-4f4b-9f14-6faa14701823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:52.638550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49135b-fbc2-4f4b-9f14-6faa14701823 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:52.639061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49135b-fbc2-4f4b-9f14-6faa14701823 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:52.639531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49135b-fbc2-4f4b-9f14-6faa14701823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:52.651358 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49135b-fbc2-4f4b-9f14-6faa14701823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:52.653179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49135b-fbc2-4f4b-9f14-6faa14701823 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8a49135b-fbc2-4f4b-9f14-6faa14701823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:44:52.673210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:52.674221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:52.675264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:44:52.675264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:44:52.675264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:44:52.675264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:52.678387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 490/970] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:52.690113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9c569-97dd-4953-92bb-92c47aeee7b3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:52.746567 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:52.800652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9c569-97dd-4953-92bb-92c47aeee7b3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:52.823341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a901b7-2e1f-4bb8-b4c0-652521468a64 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:52.823865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a901b7-2e1f-4bb8-b4c0-652521468a64 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:52.824096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a901b7-2e1f-4bb8-b4c0-652521468a64 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:52.825719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 491/971] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:52.831619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef250d-9a3f-43d6-b962-fed524ffb6a7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:52.831927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef250d-9a3f-43d6-b962-fed524ffb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:52.832172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef250d-9a3f-43d6-b962-fed524ffb6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:52.838614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf69ed-3090-4fbc-b240-154c096e2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:52.839309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf69ed-3090-4fbc-b240-154c096e2f37 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:52.839597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf69ed-3090-4fbc-b240-154c096e2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:52.839878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf69ed-3090-4fbc-b240-154c096e2f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:52.840628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf69ed-3090-4fbc-b240-154c096e2f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:52.840939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf69ed-3090-4fbc-b240-154c096e2f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:52.842393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf69ed-3090-4fbc-b240-154c096e2f37 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:52.858215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2eef250d-9a3f-43d6-b962-fed524ffb6a7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:52.858215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2eef250d-9a3f-43d6-b962-fed524ffb6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:52.858477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 481/972] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:52.862120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf69ed-3090-4fbc-b240-154c096e2f37 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:52.867461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:52.934189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 492/973] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:44:52.956671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef250d-9a3f-43d6-b962-fed524ffb6a7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:52.977645 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf69ed-3090-4fbc-b240-154c096e2f37 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:53.002548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:53.020842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370f83e-f659-4f5c-b117-3743de2ef2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:53.021671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370f83e-f659-4f5c-b117-3743de2ef2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:53.021955 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370f83e-f659-4f5c-b117-3743de2ef2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:53.022263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370f83e-f659-4f5c-b117-3743de2ef2c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:53.033085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370f83e-f659-4f5c-b117-3743de2ef2c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:53.034856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370f83e-f659-4f5c-b117-3743de2ef2c5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c370f83e-f659-4f5c-b117-3743de2ef2c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:44:53.053630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:53.054650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:53.055532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:44:53.055532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:44:53.055532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:44:53.055532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:44:53.055532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:44:53.055532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:44:53.055532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:44:53.055532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:53.055532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 482/974] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:53.060689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370f83e-f659-4f5c-b117-3743de2ef2c5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:53.085152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef250d-9a3f-43d6-b962-fed524ffb6a7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:53.134719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22c71d-ecb6-4ca4-808b-c024b6971ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:53.135800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22c71d-ecb6-4ca4-808b-c024b6971ecb None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:53.136283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22c71d-ecb6-4ca4-808b-c024b6971ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:53.136752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22c71d-ecb6-4ca4-808b-c024b6971ecb None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:53.137827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22c71d-ecb6-4ca4-808b-c024b6971ecb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:53.140382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22c71d-ecb6-4ca4-808b-c024b6971ecb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:53.167232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 493/975] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:44:52 2022] POST /identity/v3/services => generated 242 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:44:53.181874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370f83e-f659-4f5c-b117-3743de2ef2c5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:53.234279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382dec8-6263-4ca0-a442-080d9e7fd431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:53.235041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382dec8-6263-4ca0-a442-080d9e7fd431 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:53.235349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382dec8-6263-4ca0-a442-080d9e7fd431 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:53.235682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382dec8-6263-4ca0-a442-080d9e7fd431 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:53.236516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382dec8-6263-4ca0-a442-080d9e7fd431 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:53.236832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382dec8-6263-4ca0-a442-080d9e7fd431 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:53.238800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382dec8-6263-4ca0-a442-080d9e7fd431 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:53.254400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 483/976] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:53.260877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22c71d-ecb6-4ca4-808b-c024b6971ecb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:53.265173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:53.399127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22c71d-ecb6-4ca4-808b-c024b6971ecb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:53.438868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd01783-e8e8-4e6d-b3e7-be49dfe3868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:53.439807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd01783-e8e8-4e6d-b3e7-be49dfe3868d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:53.440241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd01783-e8e8-4e6d-b3e7-be49dfe3868d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:53.440662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd01783-e8e8-4e6d-b3e7-be49dfe3868d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:53.441644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd01783-e8e8-4e6d-b3e7-be49dfe3868d None admin] RBAC: Adding query filter params (role.id=aa601cdd14964e958fd1ee007671e7f9, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=3b34545615e447329344a942cd31c12a) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:53.442171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd01783-e8e8-4e6d-b3e7-be49dfe3868d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:53.443899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd01783-e8e8-4e6d-b3e7-be49dfe3868d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:53.449642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184394d-b536-4a13-8dd7-559e4d788434 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:53.450011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184394d-b536-4a13-8dd7-559e4d788434 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:53.450501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184394d-b536-4a13-8dd7-559e4d788434 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:53.451267 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 494/977] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:44:53 2022] GET /identity/v3/role_assignments?user.id=3b34545615e447329344a942cd31c12a&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=aa601cdd14964e958fd1ee007671e7f9 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:53.452032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 484/978] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:53.460936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c953-5d72-4461-bafa-e480f2410515 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:53.460936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c953-5d72-4461-bafa-e480f2410515 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:53.460936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c953-5d72-4461-bafa-e480f2410515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:53.480185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a938c953-5d72-4461-bafa-e480f2410515 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:53.481431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a938c953-5d72-4461-bafa-e480f2410515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:53.573094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:53.586508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 495/979] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:53.612309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184394d-b536-4a13-8dd7-559e4d788434 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:53.660667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:53.746902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184394d-b536-4a13-8dd7-559e4d788434 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:53.784537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5182f-4ab8-4a27-8be6-8f0c8a0416a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:53.785394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5182f-4ab8-4a27-8be6-8f0c8a0416a2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:53.785681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5182f-4ab8-4a27-8be6-8f0c8a0416a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:53.785957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5182f-4ab8-4a27-8be6-8f0c8a0416a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:53.786743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5182f-4ab8-4a27-8be6-8f0c8a0416a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:53.788154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5182f-4ab8-4a27-8be6-8f0c8a0416a2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dfd5182f-4ab8-4a27-8be6-8f0c8a0416a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:53.801886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:53.803747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:53.805069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 485/980] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:53.813170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938c953-5d72-4461-bafa-e480f2410515 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:53.909512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814119-c36e-4ee2-9aea-f5297cda3e40 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:53.909799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814119-c36e-4ee2-9aea-f5297cda3e40 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:53.910429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814119-c36e-4ee2-9aea-f5297cda3e40 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:53.912099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 486/981] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:53.918480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362346d-c44d-43a0-ab6c-b0bac7ccc35e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:53.919143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362346d-c44d-43a0-ab6c-b0bac7ccc35e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:53.919627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362346d-c44d-43a0-ab6c-b0bac7ccc35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:53.939969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8362346d-c44d-43a0-ab6c-b0bac7ccc35e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:53.942022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8362346d-c44d-43a0-ab6c-b0bac7ccc35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:53.969250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938c953-5d72-4461-bafa-e480f2410515 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:54.012821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4044cb-c220-4c48-9a74-bb11701f32b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:54.014202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4044cb-c220-4c48-9a74-bb11701f32b7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:54.014846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4044cb-c220-4c48-9a74-bb11701f32b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:54.015471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4044cb-c220-4c48-9a74-bb11701f32b7 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:54.016773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4044cb-c220-4c48-9a74-bb11701f32b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:54.017438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4044cb-c220-4c48-9a74-bb11701f32b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:54.019905 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4044cb-c220-4c48-9a74-bb11701f32b7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:54.028485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 496/983] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:54.028792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 487/983] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:44:54.036112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4044cb-c220-4c48-9a74-bb11701f32b7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:54.050483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362346d-c44d-43a0-ab6c-b0bac7ccc35e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:54.080907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:54.123792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:54.180263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362346d-c44d-43a0-ab6c-b0bac7ccc35e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:54.185097 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4044cb-c220-4c48-9a74-bb11701f32b7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:54.223423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abe871-77c7-463c-be37-9915d767a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:54.224694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abe871-77c7-463c-be37-9915d767a705 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:54.225351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abe871-77c7-463c-be37-9915d767a705 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:54.225848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abe871-77c7-463c-be37-9915d767a705 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:54.226810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abe871-77c7-463c-be37-9915d767a705 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:54.227328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abe871-77c7-463c-be37-9915d767a705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:54.228994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abe871-77c7-463c-be37-9915d767a705 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:54.229475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:54.230207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:54.230497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:54.230775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:54.231506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:54.233860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:54.236840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 497/984] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:54.242869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abe871-77c7-463c-be37-9915d767a705 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:54.249230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 12:44:54.249230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 12:44:54.249230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [parameters: {'user_id': '839d415b6d474243be786af1f2888d00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 12:44:54.249230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Jun 17 12:44:54.258996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 12:44:54.259978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 12:44:54.260969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 12:44:54.261887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 12:44:54.262917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 12:44:54.263805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'user_id': '839d415b6d474243be786af1f2888d00', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:54.264629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 17 12:44:54.267135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 17 12:44:54.269352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 17 12:44:54.269352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 17 12:44:54.269352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 12:44:54.269352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 12:44:54.269352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 12:44:54.269352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:54.269352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 488/985] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 17 12:44:54 2022] POST /identity/v3/users => generated 160 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:54.269352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:54.400481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abe871-77c7-463c-be37-9915d767a705 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:54.409278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:54.436029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadf5e5-6f8c-48f1-903b-11dfbb98a493 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:54.443134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:54.458131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd12e5-0287-48e1-8df2-67baff1c1245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:54.459759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd12e5-0287-48e1-8df2-67baff1c1245 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:54.460298 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd12e5-0287-48e1-8df2-67baff1c1245 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:54.461012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd12e5-0287-48e1-8df2-67baff1c1245 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:54.462546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd12e5-0287-48e1-8df2-67baff1c1245 None admin] RBAC: Adding query filter params (interface=admin, service_id=4cd8a6e5f3bb4a0c8b87404987ad68bf, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:54.463091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd12e5-0287-48e1-8df2-67baff1c1245 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:54.465318 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd12e5-0287-48e1-8df2-67baff1c1245 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:54.474457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 498/986] 10.222.0.48 () {56 vars in 1249 bytes} [Fri Jun 17 12:44:54 2022] GET /identity/v3/endpoints?service_id=4cd8a6e5f3bb4a0c8b87404987ad68bf&interface=admin®ion_id=RegionOne => generated 193 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:54.482126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd12e5-0287-48e1-8df2-67baff1c1245 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:54.488618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cee34-8a8e-4c36-b434-75cff77e8b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:54.489897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cee34-8a8e-4c36-b434-75cff77e8b29 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:54.490318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cee34-8a8e-4c36-b434-75cff77e8b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:54.490688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cee34-8a8e-4c36-b434-75cff77e8b29 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:54.500154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cee34-8a8e-4c36-b434-75cff77e8b29 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:54.502034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cee34-8a8e-4c36-b434-75cff77e8b29 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c85cee34-8a8e-4c36-b434-75cff77e8b29 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:44:54.518506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:54.519527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 12:44:54.520616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:44:54.528070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 489/987] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:44:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:54.529351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cee34-8a8e-4c36-b434-75cff77e8b29 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:54.602551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd12e5-0287-48e1-8df2-67baff1c1245 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:54.641802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffaeb0d-9e05-410f-ae58-d3e46eca5790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:54.643100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaeb0d-9e05-410f-ae58-d3e46eca5790 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:54.643554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaeb0d-9e05-410f-ae58-d3e46eca5790 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:54.644089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffaeb0d-9e05-410f-ae58-d3e46eca5790 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:54.645169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaeb0d-9e05-410f-ae58-d3e46eca5790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:54.647137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffaeb0d-9e05-410f-ae58-d3e46eca5790 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:54.660396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 499/988] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 12:44:54 2022] GET /identity/v3/services => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:44:54.663280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cee34-8a8e-4c36-b434-75cff77e8b29 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:54.715511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4730312-bdb2-4d66-99c0-f7405692f124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:54.716263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4730312-bdb2-4d66-99c0-f7405692f124 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:54.716614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4730312-bdb2-4d66-99c0-f7405692f124 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:54.716959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4730312-bdb2-4d66-99c0-f7405692f124 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:54.717885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4730312-bdb2-4d66-99c0-f7405692f124 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:54.718295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4730312-bdb2-4d66-99c0-f7405692f124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:54.719905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4730312-bdb2-4d66-99c0-f7405692f124 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:54.773400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 490/989] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 17 12:44:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:55.622274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53632a13-e447-4083-9c82-4c4b081fcc8e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:55.623009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53632a13-e447-4083-9c82-4c4b081fcc8e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:55.623291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53632a13-e447-4083-9c82-4c4b081fcc8e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:55.624630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 500/990] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:44:55.631452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3244-d18d-42bc-aa71-ae4eb3407691 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:55.631994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3244-d18d-42bc-aa71-ae4eb3407691 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:55.632409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3244-d18d-42bc-aa71-ae4eb3407691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:55.643349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:55.664377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ea6e3244-d18d-42bc-aa71-ae4eb3407691 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:55.666486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ea6e3244-d18d-42bc-aa71-ae4eb3407691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:55.750215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 491/991] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:55.776468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53632a13-e447-4083-9c82-4c4b081fcc8e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:55.848785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:55.906172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53632a13-e447-4083-9c82-4c4b081fcc8e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:55.957024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f964b-12ab-43c5-b65c-196f22388f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:55.957901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f964b-12ab-43c5-b65c-196f22388f15 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:55.958385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f964b-12ab-43c5-b65c-196f22388f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:55.958385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f964b-12ab-43c5-b65c-196f22388f15 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:55.959513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f964b-12ab-43c5-b65c-196f22388f15 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:55.960972 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f964b-12ab-43c5-b65c-196f22388f15 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-eb9f964b-12ab-43c5-b65c-196f22388f15 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:55.974897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:55.976230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 12:44:55.977793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:55.980638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 501/992] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:55.982700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3244-d18d-42bc-aa71-ae4eb3407691 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:56.006504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa24ef-5b14-4653-a28f-faaa98676f05 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.006797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa24ef-5b14-4653-a28f-faaa98676f05 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.007107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa24ef-5b14-4653-a28f-faaa98676f05 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.008663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 502/993] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:56.014024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad36dd0-0881-4123-bdaa-e787bffb90b3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.014460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad36dd0-0881-4123-bdaa-e787bffb90b3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.014673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad36dd0-0881-4123-bdaa-e787bffb90b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.032497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4ad36dd0-0881-4123-bdaa-e787bffb90b3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:56.033701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4ad36dd0-0881-4123-bdaa-e787bffb90b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:56.132922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3244-d18d-42bc-aa71-ae4eb3407691 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:56.139649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 503/994] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:44:56.170129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad36dd0-0881-4123-bdaa-e787bffb90b3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:56.181430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0448-3e6c-4c31-8c37-150da3fb7859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:56.182388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0448-3e6c-4c31-8c37-150da3fb7859 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.182684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0448-3e6c-4c31-8c37-150da3fb7859 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.182958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0448-3e6c-4c31-8c37-150da3fb7859 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.183760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c0448-3e6c-4c31-8c37-150da3fb7859 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:56.184009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c0448-3e6c-4c31-8c37-150da3fb7859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:56.185586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c0448-3e6c-4c31-8c37-150da3fb7859 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:56.187213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:56.194772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 492/995] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:56.200634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0448-3e6c-4c31-8c37-150da3fb7859 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:56.233873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:56.291833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad36dd0-0881-4123-bdaa-e787bffb90b3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:56.329776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0448-3e6c-4c31-8c37-150da3fb7859 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:56.342437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44763-3573-4a0f-be6d-0965671b99b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:56.343300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44763-3573-4a0f-be6d-0965671b99b8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.343580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44763-3573-4a0f-be6d-0965671b99b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.343860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44763-3573-4a0f-be6d-0965671b99b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.345381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44763-3573-4a0f-be6d-0965671b99b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:56.347067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44763-3573-4a0f-be6d-0965671b99b8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d6b44763-3573-4a0f-be6d-0965671b99b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:56.372573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:56.382402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:56.383530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 504/996] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Jun 17 12:44:56 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:44:56.387393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44763-3573-4a0f-be6d-0965671b99b8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:56.403713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7103c-3e92-4317-86ef-f329a8185324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:56.404450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7103c-3e92-4317-86ef-f329a8185324 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.404743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7103c-3e92-4317-86ef-f329a8185324 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.405024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7103c-3e92-4317-86ef-f329a8185324 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.405787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7103c-3e92-4317-86ef-f329a8185324 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:56.406157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7103c-3e92-4317-86ef-f329a8185324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:56.407638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7103c-3e92-4317-86ef-f329a8185324 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:56.414122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 493/997] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:56.420752 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7103c-3e92-4317-86ef-f329a8185324 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:56.510764 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:56.541773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44763-3573-4a0f-be6d-0965671b99b8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:56.562700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:56.566296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7103c-3e92-4317-86ef-f329a8185324 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:56.598718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0cfbe-698d-432a-829e-e70427c2ffd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:56.599544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0cfbe-698d-432a-829e-e70427c2ffd9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.599830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0cfbe-698d-432a-829e-e70427c2ffd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.600101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0cfbe-698d-432a-829e-e70427c2ffd9 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.600896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0cfbe-698d-432a-829e-e70427c2ffd9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:56.601202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0cfbe-698d-432a-829e-e70427c2ffd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:56.602696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0cfbe-698d-432a-829e-e70427c2ffd9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:56.607968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 505/998] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:56.614937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0cfbe-698d-432a-829e-e70427c2ffd9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:56.618176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc677d-2e88-40ff-8ba3-a563a095a192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:56.619519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc677d-2e88-40ff-8ba3-a563a095a192 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.619969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc677d-2e88-40ff-8ba3-a563a095a192 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.621395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc677d-2e88-40ff-8ba3-a563a095a192 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.622877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc677d-2e88-40ff-8ba3-a563a095a192 None admin] RBAC: Adding query filter params (interface=public, service_id=135ee25e2ef04b448028a3acb992efa3, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:56.623351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc677d-2e88-40ff-8ba3-a563a095a192 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:56.625705 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc677d-2e88-40ff-8ba3-a563a095a192 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:56.634898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 494/999] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 12:44:56 2022] GET /identity/v3/endpoints?service_id=135ee25e2ef04b448028a3acb992efa3&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:56.640898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc677d-2e88-40ff-8ba3-a563a095a192 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:56.762154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0cfbe-698d-432a-829e-e70427c2ffd9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:56.785383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc677d-2e88-40ff-8ba3-a563a095a192 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:56.805208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0275964-a838-4d4e-9e0d-b70513f5162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:56.806128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275964-a838-4d4e-9e0d-b70513f5162f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.806414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275964-a838-4d4e-9e0d-b70513f5162f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.806827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275964-a838-4d4e-9e0d-b70513f5162f None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.807556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275964-a838-4d4e-9e0d-b70513f5162f None admin] RBAC: Adding query filter params (type=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:56.807853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275964-a838-4d4e-9e0d-b70513f5162f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:56.809966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275964-a838-4d4e-9e0d-b70513f5162f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:56.815796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:56.816494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 506/1000] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:44:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:44:56.838371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b60027-5f18-4347-868e-88de45579289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:56.839798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b60027-5f18-4347-868e-88de45579289 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.840445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b60027-5f18-4347-868e-88de45579289 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.840923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b60027-5f18-4347-868e-88de45579289 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.841991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b60027-5f18-4347-868e-88de45579289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:56.843777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b60027-5f18-4347-868e-88de45579289 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:56.852871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 495/1001] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 12:44:56 2022] GET /identity/v3/services => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:44:56.935479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a073234-ac94-43a2-beaf-93b3ed3d763d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.935842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a073234-ac94-43a2-beaf-93b3ed3d763d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.936032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a073234-ac94-43a2-beaf-93b3ed3d763d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.937740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 507/1002] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:56.943982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe24884-51d5-4c53-a8c4-a6d62256759b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:56.944419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe24884-51d5-4c53-a8c4-a6d62256759b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:56.944597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe24884-51d5-4c53-a8c4-a6d62256759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:56.964900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1fe24884-51d5-4c53-a8c4-a6d62256759b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:56.966200 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1fe24884-51d5-4c53-a8c4-a6d62256759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:57.056209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 496/1003] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:57.081869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a073234-ac94-43a2-beaf-93b3ed3d763d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:57.134107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:57.202388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a073234-ac94-43a2-beaf-93b3ed3d763d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:57.244757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296337f-e8e3-483b-8263-2657d8fba414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:57.245689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296337f-e8e3-483b-8263-2657d8fba414 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:57.245973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296337f-e8e3-483b-8263-2657d8fba414 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:57.246280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296337f-e8e3-483b-8263-2657d8fba414 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:57.247060 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296337f-e8e3-483b-8263-2657d8fba414 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:57.249316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296337f-e8e3-483b-8263-2657d8fba414 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9296337f-e8e3-483b-8263-2657d8fba414 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:57.262876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:57.263991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 12:44:57.264828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:57.269126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 508/1004] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 17 12:44:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:57.271320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe24884-51d5-4c53-a8c4-a6d62256759b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:57.400039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe24884-51d5-4c53-a8c4-a6d62256759b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:57.428492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:57.446312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7520aea-48be-4b4f-9438-27f3aea33b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:57.447013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520aea-48be-4b4f-9438-27f3aea33b92 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:57.447296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520aea-48be-4b4f-9438-27f3aea33b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:57.447569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520aea-48be-4b4f-9438-27f3aea33b92 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:57.448416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7520aea-48be-4b4f-9438-27f3aea33b92 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:57.448721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7520aea-48be-4b4f-9438-27f3aea33b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:57.450445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7520aea-48be-4b4f-9438-27f3aea33b92 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:57.461096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 497/1005] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:57.462947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296337f-e8e3-483b-8263-2657d8fba414 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:57.588322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296337f-e8e3-483b-8263-2657d8fba414 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:57.591352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:57.635045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2716eb-c01e-4489-b9b9-e70916a96907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:57.635823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2716eb-c01e-4489-b9b9-e70916a96907 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:57.636166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2716eb-c01e-4489-b9b9-e70916a96907 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:57.636500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2716eb-c01e-4489-b9b9-e70916a96907 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:57.637229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2716eb-c01e-4489-b9b9-e70916a96907 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:57.637541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2716eb-c01e-4489-b9b9-e70916a96907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:57.639137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2716eb-c01e-4489-b9b9-e70916a96907 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:57.649909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 509/1006] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 17 12:44:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:57.651740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7520aea-48be-4b4f-9438-27f3aea33b92 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:57.772786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7520aea-48be-4b4f-9438-27f3aea33b92 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:57.821908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c3ae4-7109-4327-b6a7-95ecb7942b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:57.823436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c3ae4-7109-4327-b6a7-95ecb7942b19 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:57.824194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c3ae4-7109-4327-b6a7-95ecb7942b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:57.824868 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c3ae4-7109-4327-b6a7-95ecb7942b19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:57.826546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c3ae4-7109-4327-b6a7-95ecb7942b19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:57.829312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c3ae4-7109-4327-b6a7-95ecb7942b19 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:57.866245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 498/1007] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 12:44:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:44:59.083258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94477112-970d-425e-8dcf-393d3654c29e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:59.084043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94477112-970d-425e-8dcf-393d3654c29e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:59.084043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94477112-970d-425e-8dcf-393d3654c29e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:59.085685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 510/1008] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:59.091575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b19f11-33a4-4d38-91ed-ebe8ad568644 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:59.092159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b19f11-33a4-4d38-91ed-ebe8ad568644 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:59.092159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b19f11-33a4-4d38-91ed-ebe8ad568644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:59.113638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-60b19f11-33a4-4d38-91ed-ebe8ad568644 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:59.115860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-60b19f11-33a4-4d38-91ed-ebe8ad568644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:59.173396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:59.215703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b74ae-7848-421c-962d-0b9e369d956b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:59.216093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b74ae-7848-421c-962d-0b9e369d956b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:59.216285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b74ae-7848-421c-962d-0b9e369d956b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:59.217838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 511/1009] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:44:59.218214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 499/1010] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:59.223166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbcc68-5ced-4724-8f8b-aabcbf06dab5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:59.223512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbcc68-5ced-4724-8f8b-aabcbf06dab5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:59.223820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbcc68-5ced-4724-8f8b-aabcbf06dab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:59.240290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b19f11-33a4-4d38-91ed-ebe8ad568644 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:59.242580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-98fbcc68-5ced-4724-8f8b-aabcbf06dab5 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:44:59.243798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-98fbcc68-5ced-4724-8f8b-aabcbf06dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:44:59.338725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 512/1011] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:44:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:44:59.361658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbcc68-5ced-4724-8f8b-aabcbf06dab5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:59.382807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b19f11-33a4-4d38-91ed-ebe8ad568644 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:59.444392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d114c5e-86f9-4880-8bb5-9dc8a41bd140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:59.445252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d114c5e-86f9-4880-8bb5-9dc8a41bd140 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:59.445536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d114c5e-86f9-4880-8bb5-9dc8a41bd140 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:59.445817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d114c5e-86f9-4880-8bb5-9dc8a41bd140 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:59.446603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d114c5e-86f9-4880-8bb5-9dc8a41bd140 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:59.448007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d114c5e-86f9-4880-8bb5-9dc8a41bd140 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:59.472242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 500/1012] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:44:59 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:44:59.490414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbcc68-5ced-4724-8f8b-aabcbf06dab5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:59.494591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:59.549080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dc7af-b3e7-4df6-8806-8639aac0bb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:59.549951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dc7af-b3e7-4df6-8806-8639aac0bb10 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:59.550257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dc7af-b3e7-4df6-8806-8639aac0bb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:59.550536 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dc7af-b3e7-4df6-8806-8639aac0bb10 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:59.551443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dc7af-b3e7-4df6-8806-8639aac0bb10 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:59.553394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dc7af-b3e7-4df6-8806-8639aac0bb10 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-415dc7af-b3e7-4df6-8806-8639aac0bb10 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:44:59.569048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:44:59.570654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:44:59.571535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 513/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:44:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:44:59.577409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d114c5e-86f9-4880-8bb5-9dc8a41bd140 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:59.619813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:44:59.721651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d114c5e-86f9-4880-8bb5-9dc8a41bd140 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:44:59.791315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5172c-2e2b-4428-86cb-f1660bd0d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:44:59.792497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5172c-2e2b-4428-86cb-f1660bd0d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:44:59.792995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5172c-2e2b-4428-86cb-f1660bd0d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:44:59.793497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5172c-2e2b-4428-86cb-f1660bd0d7c8 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:44:59.794806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5172c-2e2b-4428-86cb-f1660bd0d7c8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:44:59.795312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5172c-2e2b-4428-86cb-f1660bd0d7c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:44:59.797805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5172c-2e2b-4428-86cb-f1660bd0d7c8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:44:59.805793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 501/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:44:59.813248 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dc7af-b3e7-4df6-8806-8639aac0bb10 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:44:59.998226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dc7af-b3e7-4df6-8806-8639aac0bb10 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:00.048630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3c8d8-3233-4b45-9457-bba63babf0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:00.049440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3c8d8-3233-4b45-9457-bba63babf0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:00.049769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3c8d8-3233-4b45-9457-bba63babf0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:00.050033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3c8d8-3233-4b45-9457-bba63babf0f4 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:00.050821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3c8d8-3233-4b45-9457-bba63babf0f4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:00.051122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3c8d8-3233-4b45-9457-bba63babf0f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:00.052928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3c8d8-3233-4b45-9457-bba63babf0f4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:00.061381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 514/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 17 12:44:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:00.067590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5172c-2e2b-4428-86cb-f1660bd0d7c8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:00.209523 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:00.218733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5172c-2e2b-4428-86cb-f1660bd0d7c8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:00.239560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b40e1-07d4-46fc-acf9-4866849fdc36 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:00.240341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b40e1-07d4-46fc-acf9-4866849fdc36 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:00.240341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b40e1-07d4-46fc-acf9-4866849fdc36 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:00.241846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 515/1016] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:00.247377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589eb5c-24cd-468f-8c3e-7083564f8e16 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:00.247681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589eb5c-24cd-468f-8c3e-7083564f8e16 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:00.247937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589eb5c-24cd-468f-8c3e-7083564f8e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:00.259846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbae267-9eb9-416b-9cba-b093d03ce99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:00.260519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbae267-9eb9-416b-9cba-b093d03ce99b None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:00.260802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbae267-9eb9-416b-9cba-b093d03ce99b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:00.261062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbae267-9eb9-416b-9cba-b093d03ce99b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:00.261853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbae267-9eb9-416b-9cba-b093d03ce99b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:00.263350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbae267-9eb9-416b-9cba-b093d03ce99b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:00.267347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f589eb5c-24cd-468f-8c3e-7083564f8e16 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:00.268769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f589eb5c-24cd-468f-8c3e-7083564f8e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:00.294127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 502/1017] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 12:45:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:45:00.298675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:00.378773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 516/1018] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:45:00.403200 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbae267-9eb9-416b-9cba-b093d03ce99b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:00.542776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbae267-9eb9-416b-9cba-b093d03ce99b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:00.583602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8370f64-f659-40a3-95bb-bc8e5c383d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:00.585268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8370f64-f659-40a3-95bb-bc8e5c383d04 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:00.585268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8370f64-f659-40a3-95bb-bc8e5c383d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:00.585268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8370f64-f659-40a3-95bb-bc8e5c383d04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:00.586773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8370f64-f659-40a3-95bb-bc8e5c383d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:00.587746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8370f64-f659-40a3-95bb-bc8e5c383d04 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:00.590598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 503/1019] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:00.596398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589eb5c-24cd-468f-8c3e-7083564f8e16 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:00.716267 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589eb5c-24cd-468f-8c3e-7083564f8e16 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:00.755980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4d779-db22-47d9-8d69-4d107f77a8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:00.756687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4d779-db22-47d9-8d69-4d107f77a8a3 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:00.756971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4d779-db22-47d9-8d69-4d107f77a8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:00.757231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4d779-db22-47d9-8d69-4d107f77a8a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:00.757951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4d779-db22-47d9-8d69-4d107f77a8a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:00.759487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4d779-db22-47d9-8d69-4d107f77a8a3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:00.786997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:00.796948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 517/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:45:00 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:45:01.772498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eac76-4c22-48f4-af5a-14b286d8421a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:01.773349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eac76-4c22-48f4-af5a-14b286d8421a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:01.773349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eac76-4c22-48f4-af5a-14b286d8421a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:01.775282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 504/1021] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:45:01.781198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9fd4a-d5ba-4191-b94f-28565ca0be10 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:01.781749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9fd4a-d5ba-4191-b94f-28565ca0be10 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:01.781847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9fd4a-d5ba-4191-b94f-28565ca0be10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:01.799804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b3a9fd4a-d5ba-4191-b94f-28565ca0be10 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:01.801011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b3a9fd4a-d5ba-4191-b94f-28565ca0be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:01.883004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 518/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:01.907368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eac76-4c22-48f4-af5a-14b286d8421a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:01.930800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:02.036278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eac76-4c22-48f4-af5a-14b286d8421a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:02.078424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77273a-5452-4095-bbe3-b9ba371136bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:02.079276 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77273a-5452-4095-bbe3-b9ba371136bf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:02.079558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77273a-5452-4095-bbe3-b9ba371136bf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:02.079834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77273a-5452-4095-bbe3-b9ba371136bf None admin] PATH_INFO: `/v3/services/image` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:02.080501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77273a-5452-4095-bbe3-b9ba371136bf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:02.081928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77273a-5452-4095-bbe3-b9ba371136bf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4e77273a-5452-4095-bbe3-b9ba371136bf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:02.095739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:02.096919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 12:45:02.097763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:02.105519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 505/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Jun 17 12:45:01 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:02.105787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9fd4a-d5ba-4191-b94f-28565ca0be10 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:02.265034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9fd4a-d5ba-4191-b94f-28565ca0be10 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:02.307041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:02.320143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d894db4-9930-4b05-b510-344d14acbab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:02.320853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d894db4-9930-4b05-b510-344d14acbab8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:02.321133 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d894db4-9930-4b05-b510-344d14acbab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:02.321394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d894db4-9930-4b05-b510-344d14acbab8 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:02.322139 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d894db4-9930-4b05-b510-344d14acbab8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:02.322459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d894db4-9930-4b05-b510-344d14acbab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:02.324002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d894db4-9930-4b05-b510-344d14acbab8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:02.330623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 519/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:02.337315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77273a-5452-4095-bbe3-b9ba371136bf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:02.469957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:02.507770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77273a-5452-4095-bbe3-b9ba371136bf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:02.568722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c50a93-2f6f-4269-b9b5-470b561156e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:02.569801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c50a93-2f6f-4269-b9b5-470b561156e3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:02.570361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c50a93-2f6f-4269-b9b5-470b561156e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:02.570864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c50a93-2f6f-4269-b9b5-470b561156e3 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:02.572262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c50a93-2f6f-4269-b9b5-470b561156e3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:02.572823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c50a93-2f6f-4269-b9b5-470b561156e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:02.575499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c50a93-2f6f-4269-b9b5-470b561156e3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:02.590945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 506/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:02.592840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d894db4-9930-4b05-b510-344d14acbab8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:02.665579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd659-17b4-41db-802e-c13a359e2b5b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:02.665878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd659-17b4-41db-802e-c13a359e2b5b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:02.666145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd659-17b4-41db-802e-c13a359e2b5b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:02.667817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 507/1026] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:45:02.673231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01a51-8f8f-4923-8032-faeb7e890138 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:02.673504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01a51-8f8f-4923-8032-faeb7e890138 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:02.673823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01a51-8f8f-4923-8032-faeb7e890138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:02.691332 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c4e01a51-8f8f-4923-8032-faeb7e890138 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:02.692755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c4e01a51-8f8f-4923-8032-faeb7e890138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:02.724921 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d894db4-9930-4b05-b510-344d14acbab8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:02.767023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb2b73-5252-4836-b9f3-d26770703266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:02.767604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb2b73-5252-4836-b9f3-d26770703266 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:02.767890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb2b73-5252-4836-b9f3-d26770703266 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:02.768165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb2b73-5252-4836-b9f3-d26770703266 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:02.768968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb2b73-5252-4836-b9f3-d26770703266 None admin] RBAC: Adding query filter params (interface=public, service_id=cbcf729808dc463e8ebb2ac7e23a04b5, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:02.769281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb2b73-5252-4836-b9f3-d26770703266 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:02.771333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb2b73-5252-4836-b9f3-d26770703266 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:02.775160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 508/1027] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:02.782015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 520/1028] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 12:45:02 2022] GET /identity/v3/endpoints?service_id=cbcf729808dc463e8ebb2ac7e23a04b5&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:02.788132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01a51-8f8f-4923-8032-faeb7e890138 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:02.806114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb2b73-5252-4836-b9f3-d26770703266 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:02.881503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:02.907773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:02.912606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01a51-8f8f-4923-8032-faeb7e890138 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:02.961454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760ee98-c428-45ad-b1c3-896bdbfc04cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:02.962187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760ee98-c428-45ad-b1c3-896bdbfc04cf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:02.962487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760ee98-c428-45ad-b1c3-896bdbfc04cf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:02.962758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760ee98-c428-45ad-b1c3-896bdbfc04cf None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:02.963265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb2b73-5252-4836-b9f3-d26770703266 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:02.963459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760ee98-c428-45ad-b1c3-896bdbfc04cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:02.964996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760ee98-c428-45ad-b1c3-896bdbfc04cf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:02.972468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 509/1029] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 12:45:02 2022] GET /identity/v3/services => generated 1957 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:45:03.022499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1d987-69a4-45e0-8e5b-4b6aedbd7482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:03.023964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d987-69a4-45e0-8e5b-4b6aedbd7482 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:03.024436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d987-69a4-45e0-8e5b-4b6aedbd7482 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:03.024906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1d987-69a4-45e0-8e5b-4b6aedbd7482 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:03.045394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1d987-69a4-45e0-8e5b-4b6aedbd7482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-37b1d987-69a4-45e0-8e5b-4b6aedbd7482 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:03.062432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:03.063568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:03.071045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 521/1030] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 12:45:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:03.075180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760ee98-c428-45ad-b1c3-896bdbfc04cf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:03.134544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9a9f4-723b-46f8-a931-fbec01cbbe5e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:03.134765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9a9f4-723b-46f8-a931-fbec01cbbe5e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:03.135031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9a9f4-723b-46f8-a931-fbec01cbbe5e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:03.136650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 522/1031] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:45:03.142785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b236978-c379-43d1-9d83-14f5d9732b4b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:03.143055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b236978-c379-43d1-9d83-14f5d9732b4b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:03.143322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b236978-c379-43d1-9d83-14f5d9732b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:03.164663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2b236978-c379-43d1-9d83-14f5d9732b4b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:03.166289 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2b236978-c379-43d1-9d83-14f5d9732b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:03.207026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760ee98-c428-45ad-b1c3-896bdbfc04cf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:03.247270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad25c4-66b6-4a91-a1d3-3209689fbba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:03.247977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad25c4-66b6-4a91-a1d3-3209689fbba6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:03.248265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad25c4-66b6-4a91-a1d3-3209689fbba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:03.248545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad25c4-66b6-4a91-a1d3-3209689fbba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:03.249315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad25c4-66b6-4a91-a1d3-3209689fbba6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:03.249627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad25c4-66b6-4a91-a1d3-3209689fbba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:03.251181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad25c4-66b6-4a91-a1d3-3209689fbba6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:03.262149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 510/1032] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 12:45:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:03.263620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 523/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:45:03.266767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad25c4-66b6-4a91-a1d3-3209689fbba6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:03.269946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:03.295529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b236978-c379-43d1-9d83-14f5d9732b4b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:03.353448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:03.399062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad25c4-66b6-4a91-a1d3-3209689fbba6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:03.426928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b236978-c379-43d1-9d83-14f5d9732b4b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:03.444642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bcccc-eeef-40a7-bec2-bad891893ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:03.446340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bcccc-eeef-40a7-bec2-bad891893ced None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:03.447039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bcccc-eeef-40a7-bec2-bad891893ced None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:03.447689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bcccc-eeef-40a7-bec2-bad891893ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:03.466223 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bcccc-eeef-40a7-bec2-bad891893ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:03.468253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bcccc-eeef-40a7-bec2-bad891893ced None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:03.484166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad117bf8-d2f5-42e1-90fd-255df94ddfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:03.485190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad117bf8-d2f5-42e1-90fd-255df94ddfaa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:03.485597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad117bf8-d2f5-42e1-90fd-255df94ddfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:03.485993 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad117bf8-d2f5-42e1-90fd-255df94ddfaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:03.487446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad117bf8-d2f5-42e1-90fd-255df94ddfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:03.490295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad117bf8-d2f5-42e1-90fd-255df94ddfaa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2a4bcccc-eeef-40a7-bec2-bad891893ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:45:03.490814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:03.492447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:03.499336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:45:03.499336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:45:03.499336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:03.499336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:03.499638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 524/1034] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:03.499740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 511/1035] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:03.499894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad117bf8-d2f5-42e1-90fd-255df94ddfaa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:03.501990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bcccc-eeef-40a7-bec2-bad891893ced None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:03.582043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:03.635746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bcccc-eeef-40a7-bec2-bad891893ced None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:03.659252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad117bf8-d2f5-42e1-90fd-255df94ddfaa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:03.681003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:03.684676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea087d-0011-433c-827c-606213483c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:03.685718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea087d-0011-433c-827c-606213483c5f None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:03.686225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea087d-0011-433c-827c-606213483c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:03.686703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea087d-0011-433c-827c-606213483c5f None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:03.687605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea087d-0011-433c-827c-606213483c5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:03.689605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea087d-0011-433c-827c-606213483c5f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:03.706170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a178edf-aae3-4514-a375-e0d6d96b194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:03.707218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a178edf-aae3-4514-a375-e0d6d96b194a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:03.707699 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a178edf-aae3-4514-a375-e0d6d96b194a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:03.708249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a178edf-aae3-4514-a375-e0d6d96b194a None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:03.709619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a178edf-aae3-4514-a375-e0d6d96b194a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:03.709939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a178edf-aae3-4514-a375-e0d6d96b194a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:03.711877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a178edf-aae3-4514-a375-e0d6d96b194a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:03.719610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 512/1036] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:45:03 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:45:03.742044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 525/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:03.744508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea087d-0011-433c-827c-606213483c5f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:03.906082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea087d-0011-433c-827c-606213483c5f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:03.920546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:03.955312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cfd58-f44c-43c6-831d-6d741339fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:03.962295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cfd58-f44c-43c6-831d-6d741339fce8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:03.962295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cfd58-f44c-43c6-831d-6d741339fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:03.962295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cfd58-f44c-43c6-831d-6d741339fce8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:03.973638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cfd58-f44c-43c6-831d-6d741339fce8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:03.975398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cfd58-f44c-43c6-831d-6d741339fce8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-918cfd58-f44c-43c6-831d-6d741339fce8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:45:03.993209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:03.995689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:03.997647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 513/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 12:45:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:04.001814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a178edf-aae3-4514-a375-e0d6d96b194a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:04.139990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a178edf-aae3-4514-a375-e0d6d96b194a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:04.188408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d54f9-1e39-484c-95a4-8d262d334f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:04.189019 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d54f9-1e39-484c-95a4-8d262d334f04 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:04.189299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d54f9-1e39-484c-95a4-8d262d334f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:04.189570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d54f9-1e39-484c-95a4-8d262d334f04 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:04.190464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d54f9-1e39-484c-95a4-8d262d334f04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:04.190775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d54f9-1e39-484c-95a4-8d262d334f04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:04.192437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d54f9-1e39-484c-95a4-8d262d334f04 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:04.221776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 526/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 12:45:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:04.227910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cfd58-f44c-43c6-831d-6d741339fce8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:04.388614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cfd58-f44c-43c6-831d-6d741339fce8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:04.444244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba150ae-ccae-42c4-b735-b60fbc002dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:04.444826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba150ae-ccae-42c4-b735-b60fbc002dbf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:04.445452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba150ae-ccae-42c4-b735-b60fbc002dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:04.445746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba150ae-ccae-42c4-b735-b60fbc002dbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:04.495286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:04.531462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba150ae-ccae-42c4-b735-b60fbc002dbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:04.533022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba150ae-ccae-42c4-b735-b60fbc002dbf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:04.684541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 514/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:04.693396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d54f9-1e39-484c-95a4-8d262d334f04 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:04.750910 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:04.835170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d54f9-1e39-484c-95a4-8d262d334f04 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:04.882208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ba6ed-abff-40f0-bb8b-622432c750c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:04.883049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ba6ed-abff-40f0-bb8b-622432c750c5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:04.883331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ba6ed-abff-40f0-bb8b-622432c750c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:04.883611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ba6ed-abff-40f0-bb8b-622432c750c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:04.901954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ba6ed-abff-40f0-bb8b-622432c750c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:04.904208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ba6ed-abff-40f0-bb8b-622432c750c5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-da0ba6ed-abff-40f0-bb8b-622432c750c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:45:04.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:04.929257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:04.931670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:45:04.931670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:45:04.931670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:04.931670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:04.932763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 527/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:04.935490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba150ae-ccae-42c4-b735-b60fbc002dbf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:05.030224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:05.070840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba150ae-ccae-42c4-b735-b60fbc002dbf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:05.126913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69452cf-6c59-4bf8-bd1c-95ca9327cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:05.127604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69452cf-6c59-4bf8-bd1c-95ca9327cfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:05.127928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69452cf-6c59-4bf8-bd1c-95ca9327cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:05.128209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69452cf-6c59-4bf8-bd1c-95ca9327cfb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:05.129032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69452cf-6c59-4bf8-bd1c-95ca9327cfb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:05.129348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69452cf-6c59-4bf8-bd1c-95ca9327cfb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:05.131075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69452cf-6c59-4bf8-bd1c-95ca9327cfb7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:05.149510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 515/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:05.150975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ba6ed-abff-40f0-bb8b-622432c750c5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:05.240846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3b4d-cb94-492d-8ea7-683c87048145 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:05.241173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3b4d-cb94-492d-8ea7-683c87048145 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:05.241439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3b4d-cb94-492d-8ea7-683c87048145 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:05.243127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 516/1043] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:05.248462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e3a7-6b5e-4d66-8c4e-fe4c915e1cc4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:05.248749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e3a7-6b5e-4d66-8c4e-fe4c915e1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:05.249034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e3a7-6b5e-4d66-8c4e-fe4c915e1cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:05.260558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:05.267958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9e99e3a7-6b5e-4d66-8c4e-fe4c915e1cc4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:05.269179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9e99e3a7-6b5e-4d66-8c4e-fe4c915e1cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:05.279258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ba6ed-abff-40f0-bb8b-622432c750c5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:05.321374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919accf9-d610-4adb-86e3-0453822ceb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:05.322353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919accf9-d610-4adb-86e3-0453822ceb62 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:05.322640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919accf9-d610-4adb-86e3-0453822ceb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:05.322919 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919accf9-d610-4adb-86e3-0453822ceb62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:05.335272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919accf9-d610-4adb-86e3-0453822ceb62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:05.337181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919accf9-d610-4adb-86e3-0453822ceb62 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-919accf9-d610-4adb-86e3-0453822ceb62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:45:05.356364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:05.358389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:05.359582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:45:05.359582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:45:05.359582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:45:05.359582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:45:05.359582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:45:05.359582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:45:05.359582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:45:05.359582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:05.359582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 528/1044] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:05.365220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 517/1045] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:45:05.367191 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919accf9-d610-4adb-86e3-0453822ceb62 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:05.405341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99e3a7-6b5e-4d66-8c4e-fe4c915e1cc4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:05.502370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:05.529601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919accf9-d610-4adb-86e3-0453822ceb62 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:05.573946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99e3a7-6b5e-4d66-8c4e-fe4c915e1cc4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:05.575678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbcc75-14fc-461f-9d22-db945410e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:05.576485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbcc75-14fc-461f-9d22-db945410e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:05.576774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbcc75-14fc-461f-9d22-db945410e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:05.577094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbcc75-14fc-461f-9d22-db945410e4e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:05.577901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbcc75-14fc-461f-9d22-db945410e4e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:05.578259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbcc75-14fc-461f-9d22-db945410e4e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:05.579970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbcc75-14fc-461f-9d22-db945410e4e2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:05.598513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 529/1046] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:05.609237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbcc75-14fc-461f-9d22-db945410e4e2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:05.622698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:05.641167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a0610-1b47-4ad7-87dc-82fcff580c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:05.642532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0610-1b47-4ad7-87dc-82fcff580c47 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:05.642994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0610-1b47-4ad7-87dc-82fcff580c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:05.643450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0610-1b47-4ad7-87dc-82fcff580c47 None admin] PATH_INFO: `/v3/services/image` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:05.644762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a0610-1b47-4ad7-87dc-82fcff580c47 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:05.647423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a0610-1b47-4ad7-87dc-82fcff580c47 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c95a0610-1b47-4ad7-87dc-82fcff580c47 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:05.669507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:05.670699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 12:45:05.671727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:05.672577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 518/1047] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Jun 17 12:45:05 2022] GET /identity/v3/services/image => generated 86 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:05.681966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a0610-1b47-4ad7-87dc-82fcff580c47 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:05.764026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbcc75-14fc-461f-9d22-db945410e4e2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:05.812030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee4fa1-2ca9-40e7-9e8d-9788bbd3fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:05.812866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee4fa1-2ca9-40e7-9e8d-9788bbd3fe9c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:05.813146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee4fa1-2ca9-40e7-9e8d-9788bbd3fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:05.813423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee4fa1-2ca9-40e7-9e8d-9788bbd3fe9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:05.814300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee4fa1-2ca9-40e7-9e8d-9788bbd3fe9c None admin] RBAC: Adding query filter params (role.id=aa601cdd14964e958fd1ee007671e7f9, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=09a967d14a7243068a016b4677e47234) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:05.814612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee4fa1-2ca9-40e7-9e8d-9788bbd3fe9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:05.816105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee4fa1-2ca9-40e7-9e8d-9788bbd3fe9c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:05.823124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 530/1048] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:45:05 2022] GET /identity/v3/role_assignments?user.id=09a967d14a7243068a016b4677e47234&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=aa601cdd14964e958fd1ee007671e7f9 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:05.853152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a0610-1b47-4ad7-87dc-82fcff580c47 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:05.886310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:05.902863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275a190-106a-4d4b-a873-2f789df816e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:05.903662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275a190-106a-4d4b-a873-2f789df816e3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:05.903966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275a190-106a-4d4b-a873-2f789df816e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:05.904246 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275a190-106a-4d4b-a873-2f789df816e3 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:05.904995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275a190-106a-4d4b-a873-2f789df816e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:05.905395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275a190-106a-4d4b-a873-2f789df816e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:05.906914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275a190-106a-4d4b-a873-2f789df816e3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:05.920580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 519/1049] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:05.921850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee4fa1-2ca9-40e7-9e8d-9788bbd3fe9c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:06.016030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:06.062407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee4fa1-2ca9-40e7-9e8d-9788bbd3fe9c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:06.097006 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338fd22-4d9b-4d82-a689-5f7a151979c9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:06.097589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338fd22-4d9b-4d82-a689-5f7a151979c9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:06.097589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338fd22-4d9b-4d82-a689-5f7a151979c9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:06.099643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 520/1050] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:06.105937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ff4d2-bd1f-46aa-a22b-0e2a4a447a82 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:06.106897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ff4d2-bd1f-46aa-a22b-0e2a4a447a82 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:06.107347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ff4d2-bd1f-46aa-a22b-0e2a4a447a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:06.112827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7de87-c853-4a17-b519-e4d131cf1173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:06.114167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7de87-c853-4a17-b519-e4d131cf1173 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:06.114452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7de87-c853-4a17-b519-e4d131cf1173 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:06.114452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7de87-c853-4a17-b519-e4d131cf1173 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:06.115229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7de87-c853-4a17-b519-e4d131cf1173 None admin] RBAC: Adding query filter params (type=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:06.115569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7de87-c853-4a17-b519-e4d131cf1173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:06.117115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7de87-c853-4a17-b519-e4d131cf1173 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:06.123337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 531/1051] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:06.127516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-480ff4d2-bd1f-46aa-a22b-0e2a4a447a82 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:06.128988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-480ff4d2-bd1f-46aa-a22b-0e2a4a447a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:06.129133 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7de87-c853-4a17-b519-e4d131cf1173 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:06.216643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 521/1052] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:45:06.240020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ff4d2-bd1f-46aa-a22b-0e2a4a447a82 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:06.259623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7de87-c853-4a17-b519-e4d131cf1173 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:06.303105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007690f-1398-4fb2-88a6-149b230c5357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:06.303799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007690f-1398-4fb2-88a6-149b230c5357 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:06.304114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007690f-1398-4fb2-88a6-149b230c5357 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:06.304415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007690f-1398-4fb2-88a6-149b230c5357 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:06.305179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007690f-1398-4fb2-88a6-149b230c5357 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:06.307255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007690f-1398-4fb2-88a6-149b230c5357 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:06.312106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:06.345951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 532/1053] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 12:45:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:45:06.376640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ff4d2-bd1f-46aa-a22b-0e2a4a447a82 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:06.404989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:06.437717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336dd89-074c-4824-b0ad-c07ae170a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:06.438267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336dd89-074c-4824-b0ad-c07ae170a881 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:06.438558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336dd89-074c-4824-b0ad-c07ae170a881 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:06.438839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336dd89-074c-4824-b0ad-c07ae170a881 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:06.460326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336dd89-074c-4824-b0ad-c07ae170a881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8336dd89-074c-4824-b0ad-c07ae170a881 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:06.479809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:06.481419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:06.482515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 522/1054] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:06.485182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007690f-1398-4fb2-88a6-149b230c5357 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:06.643516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007690f-1398-4fb2-88a6-149b230c5357 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:06.707416 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3f7b8-f85a-4552-a722-5ffa28554065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:06.708406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3f7b8-f85a-4552-a722-5ffa28554065 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:06.708838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3f7b8-f85a-4552-a722-5ffa28554065 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:06.709296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3f7b8-f85a-4552-a722-5ffa28554065 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:06.710387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3f7b8-f85a-4552-a722-5ffa28554065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:06.710684 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3f7b8-f85a-4552-a722-5ffa28554065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:06.712305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3f7b8-f85a-4552-a722-5ffa28554065 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:06.724841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 533/1055] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:06.730757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336dd89-074c-4824-b0ad-c07ae170a881 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:06.866755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336dd89-074c-4824-b0ad-c07ae170a881 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:06.908582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf46c-52dd-4ce9-b8aa-e03d4b8dd146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:06.909511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf46c-52dd-4ce9-b8aa-e03d4b8dd146 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:06.909792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf46c-52dd-4ce9-b8aa-e03d4b8dd146 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:06.910063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf46c-52dd-4ce9-b8aa-e03d4b8dd146 None admin] PATH_INFO: `/v3/users/43da64bfa5b6489485b4f8bc266ca7a1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:06.929935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cf46c-52dd-4ce9-b8aa-e03d4b8dd146 None admin] RBAC: Authorizing `identity:get_user(user_id=43da64bfa5b6489485b4f8bc266ca7a1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:06.932687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cf46c-52dd-4ce9-b8aa-e03d4b8dd146 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:06.936134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 523/1056] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:06 2022] GET /identity/v3/users/43da64bfa5b6489485b4f8bc266ca7a1 => generated 285 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:06.945412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3f7b8-f85a-4552-a722-5ffa28554065 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:07.038957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:07.115093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3f7b8-f85a-4552-a722-5ffa28554065 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:07.156555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec269c19-e0a1-44ec-a098-92097f9b2b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:07.157234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec269c19-e0a1-44ec-a098-92097f9b2b8e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:07.157500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec269c19-e0a1-44ec-a098-92097f9b2b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:07.157774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec269c19-e0a1-44ec-a098-92097f9b2b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:07.236867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec269c19-e0a1-44ec-a098-92097f9b2b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:07.238671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec269c19-e0a1-44ec-a098-92097f9b2b8e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:07.318378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:07.401042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 534/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:07.407537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf46c-52dd-4ce9-b8aa-e03d4b8dd146 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:07.452091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:07.546168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf46c-52dd-4ce9-b8aa-e03d4b8dd146 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:07.602732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7e850-77d8-4716-8a5b-85d32b8e6193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:07.603696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7e850-77d8-4716-8a5b-85d32b8e6193 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:07.603918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7e850-77d8-4716-8a5b-85d32b8e6193 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:07.604195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7e850-77d8-4716-8a5b-85d32b8e6193 None admin] PATH_INFO: `/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:07.605453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7e850-77d8-4716-8a5b-85d32b8e6193 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d5396cc664c72b3fc6df12ceeb86a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:07.606960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7e850-77d8-4716-8a5b-85d32b8e6193 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:07.608974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 524/1058] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:07 2022] GET /identity/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a => generated 311 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:07.615532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec269c19-e0a1-44ec-a098-92097f9b2b8e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:07.750496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec269c19-e0a1-44ec-a098-92097f9b2b8e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:07.806131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40414715-f1f6-49f1-97f8-a967efecf8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:07.806985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40414715-f1f6-49f1-97f8-a967efecf8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:07.807307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40414715-f1f6-49f1-97f8-a967efecf8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:07.807589 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40414715-f1f6-49f1-97f8-a967efecf8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:07.808726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40414715-f1f6-49f1-97f8-a967efecf8e8 None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=6b4d5396cc664c72b3fc6df12ceeb86a, user.id=43da64bfa5b6489485b4f8bc266ca7a1) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:07.809148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40414715-f1f6-49f1-97f8-a967efecf8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:07.811530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40414715-f1f6-49f1-97f8-a967efecf8e8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:07.826758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 535/1059] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:45:07 2022] GET /identity/v3/role_assignments?user.id=43da64bfa5b6489485b4f8bc266ca7a1&scope.project.id=6b4d5396cc664c72b3fc6df12ceeb86a&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:08.243796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb801d4-acdd-4c0f-96f0-6fdffb6a064a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:08.244150 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb801d4-acdd-4c0f-96f0-6fdffb6a064a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:08.244355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb801d4-acdd-4c0f-96f0-6fdffb6a064a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:08.246045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 525/1060] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:08.251649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7217-c37f-4163-9303-9b68940f8fe3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:08.251929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7217-c37f-4163-9303-9b68940f8fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:08.252207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7217-c37f-4163-9303-9b68940f8fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:08.271535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-190e7217-c37f-4163-9303-9b68940f8fe3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:08.272812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-190e7217-c37f-4163-9303-9b68940f8fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:08.287553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:08.385914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 536/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:08.407598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb801d4-acdd-4c0f-96f0-6fdffb6a064a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:08.530927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:08.537985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb801d4-acdd-4c0f-96f0-6fdffb6a064a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:08.582208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb58ea8-4e04-46f9-b76a-725204cd59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:08.583296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb58ea8-4e04-46f9-b76a-725204cd59bd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:08.583642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb58ea8-4e04-46f9-b76a-725204cd59bd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:08.583917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb58ea8-4e04-46f9-b76a-725204cd59bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:08.597022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb58ea8-4e04-46f9-b76a-725204cd59bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7cb58ea8-4e04-46f9-b76a-725204cd59bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:08.606148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:08.607235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:45:08.608241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:08.610570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 526/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 12:45:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:08.614726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e7217-c37f-4163-9303-9b68940f8fe3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:08.690082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7d353-328d-4137-8ef1-6c940d2d617e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:08.690459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7d353-328d-4137-8ef1-6c940d2d617e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:08.690773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7d353-328d-4137-8ef1-6c940d2d617e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:08.692316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 527/1063] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:08.701018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61555c11-d86d-4492-86a5-ccb51ba54d29 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:08.701401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61555c11-d86d-4492-86a5-ccb51ba54d29 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:08.701766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61555c11-d86d-4492-86a5-ccb51ba54d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:08.726590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-61555c11-d86d-4492-86a5-ccb51ba54d29 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:08.727796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-61555c11-d86d-4492-86a5-ccb51ba54d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:08.766709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e7217-c37f-4163-9303-9b68940f8fe3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:08.806225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 528/1064] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:08.806406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467601ae-a81e-4edc-a2b2-1a9767c20760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:08.806406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467601ae-a81e-4edc-a2b2-1a9767c20760 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:08.806562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467601ae-a81e-4edc-a2b2-1a9767c20760 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:08.806885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467601ae-a81e-4edc-a2b2-1a9767c20760 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:08.807989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467601ae-a81e-4edc-a2b2-1a9767c20760 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:08.807989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467601ae-a81e-4edc-a2b2-1a9767c20760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:08.809323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467601ae-a81e-4edc-a2b2-1a9767c20760 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:08.818643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 537/1065] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 12:45:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:08.824221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61555c11-d86d-4492-86a5-ccb51ba54d29 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:08.826717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467601ae-a81e-4edc-a2b2-1a9767c20760 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:08.840552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:08.946028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:08.956830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61555c11-d86d-4492-86a5-ccb51ba54d29 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:08.961346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467601ae-a81e-4edc-a2b2-1a9767c20760 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:08.996017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bde28-0e0a-4023-a0d1-2936e926e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:08.997352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bde28-0e0a-4023-a0d1-2936e926e96d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:08.997640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bde28-0e0a-4023-a0d1-2936e926e96d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:08.997921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bde28-0e0a-4023-a0d1-2936e926e96d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:09.001282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140210-a680-400a-873c-97652de33279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:09.001962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140210-a680-400a-873c-97652de33279 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:09.002144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140210-a680-400a-873c-97652de33279 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:09.002421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140210-a680-400a-873c-97652de33279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:09.011624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bde28-0e0a-4023-a0d1-2936e926e96d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:09.013193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bde28-0e0a-4023-a0d1-2936e926e96d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-1b0bde28-0e0a-4023-a0d1-2936e926e96d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:45:09.034033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:09.035677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:09.037038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:45:09.037038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:45:09.037038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:09.037038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:09.037038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 529/1066] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:09.041915 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bde28-0e0a-4023-a0d1-2936e926e96d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:09.083524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c140210-a680-400a-873c-97652de33279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:09.085171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c140210-a680-400a-873c-97652de33279 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:09.095911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:09.162346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bde28-0e0a-4023-a0d1-2936e926e96d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:09.200137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc5356-f761-48b8-82d3-597d6aff45cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:09.205351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 538/1067] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:09.205488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc5356-f761-48b8-82d3-597d6aff45cb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:09.205488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc5356-f761-48b8-82d3-597d6aff45cb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:09.205488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc5356-f761-48b8-82d3-597d6aff45cb None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:09.205488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc5356-f761-48b8-82d3-597d6aff45cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:09.205488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc5356-f761-48b8-82d3-597d6aff45cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:09.205488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc5356-f761-48b8-82d3-597d6aff45cb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:09.206347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140210-a680-400a-873c-97652de33279 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:09.222245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 530/1068] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:09.223335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc5356-f761-48b8-82d3-597d6aff45cb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:09.227469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:09.357932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140210-a680-400a-873c-97652de33279 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:09.366226 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc5356-f761-48b8-82d3-597d6aff45cb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:09.369417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:09.404068 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873fd15-6d28-48b6-8318-8615aafc4280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:09.405019 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873fd15-6d28-48b6-8318-8615aafc4280 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:09.405379 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873fd15-6d28-48b6-8318-8615aafc4280 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:09.405729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873fd15-6d28-48b6-8318-8615aafc4280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:09.417661 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873fd15-6d28-48b6-8318-8615aafc4280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:09.419434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873fd15-6d28-48b6-8318-8615aafc4280 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:09.419566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756776-8c3e-4b6d-8f52-89bb3fc83527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:09.420452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756776-8c3e-4b6d-8f52-89bb3fc83527 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:09.420748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756776-8c3e-4b6d-8f52-89bb3fc83527 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:09.421018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9756776-8c3e-4b6d-8f52-89bb3fc83527 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:09.437236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9756776-8c3e-4b6d-8f52-89bb3fc83527 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:09.440025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9756776-8c3e-4b6d-8f52-89bb3fc83527 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4873fd15-6d28-48b6-8318-8615aafc4280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:45:09.443663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:09.447697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:09.449404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:45:09.449404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:45:09.449404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:09.449404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:09.449404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 539/1069] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:09.451723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873fd15-6d28-48b6-8318-8615aafc4280 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f9756776-8c3e-4b6d-8f52-89bb3fc83527 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:45:09.471621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:09.481736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 531/1070] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 12:45:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:09.483715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756776-8c3e-4b6d-8f52-89bb3fc83527 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:09.568513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:09.630490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9756776-8c3e-4b6d-8f52-89bb3fc83527 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:09.635735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873fd15-6d28-48b6-8318-8615aafc4280 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:09.675812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51b376-6031-4d4b-b449-114b8f746bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:09.676593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51b376-6031-4d4b-b449-114b8f746bce None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:09.677353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51b376-6031-4d4b-b449-114b8f746bce None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:09.677353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51b376-6031-4d4b-b449-114b8f746bce None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:09.678190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51b376-6031-4d4b-b449-114b8f746bce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:09.678610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51b376-6031-4d4b-b449-114b8f746bce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:09.680094 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51b376-6031-4d4b-b449-114b8f746bce None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:09.695434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77394a-4fde-459e-827c-61275aeeae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:09.696590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77394a-4fde-459e-827c-61275aeeae24 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:09.697069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77394a-4fde-459e-827c-61275aeeae24 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:09.697524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77394a-4fde-459e-827c-61275aeeae24 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:09.698781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77394a-4fde-459e-827c-61275aeeae24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:09.699338 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77394a-4fde-459e-827c-61275aeeae24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:09.702390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 532/1071] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 12:45:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:09.702635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77394a-4fde-459e-827c-61275aeeae24 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:09.708692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51b376-6031-4d4b-b449-114b8f746bce None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:09.742135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 540/1072] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:09.874411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51b376-6031-4d4b-b449-114b8f746bce None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:09.910245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:09.931897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61bb61-5584-4070-9fe3-6cfc9ff476eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:09.932702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61bb61-5584-4070-9fe3-6cfc9ff476eb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:09.932995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61bb61-5584-4070-9fe3-6cfc9ff476eb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:09.933272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61bb61-5584-4070-9fe3-6cfc9ff476eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:09.947456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61bb61-5584-4070-9fe3-6cfc9ff476eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:09.949027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61bb61-5584-4070-9fe3-6cfc9ff476eb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5f61bb61-5584-4070-9fe3-6cfc9ff476eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:45:09.972674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:09.974835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:09.976350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:45:09.976350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:45:09.976350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:09.976350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:09.978527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 533/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:09.980068 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77394a-4fde-459e-827c-61275aeeae24 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:10.011755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:10.132817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e6335-5b53-4244-8436-ce0e0f18a76e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:10.133552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e6335-5b53-4244-8436-ce0e0f18a76e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:10.133831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e6335-5b53-4244-8436-ce0e0f18a76e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:10.135513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 534/1074] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:45:10.141331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77394a-4fde-459e-827c-61275aeeae24 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:10.143143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d7a4e-737b-4774-a5b5-0ad931f0a54d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:10.143452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d7a4e-737b-4774-a5b5-0ad931f0a54d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:10.143731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d7a4e-737b-4774-a5b5-0ad931f0a54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:10.172442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4b7d7a4e-737b-4774-a5b5-0ad931f0a54d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:10.173583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4b7d7a4e-737b-4774-a5b5-0ad931f0a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:10.189673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5fa44-9995-403b-a28a-af81efbd44c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:10.190586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5fa44-9995-403b-a28a-af81efbd44c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:10.190752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5fa44-9995-403b-a28a-af81efbd44c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:10.190953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5fa44-9995-403b-a28a-af81efbd44c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:10.191741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5fa44-9995-403b-a28a-af81efbd44c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:10.192111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5fa44-9995-403b-a28a-af81efbd44c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:10.193544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5fa44-9995-403b-a28a-af81efbd44c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:10.208801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 541/1075] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:10.217302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5fa44-9995-403b-a28a-af81efbd44c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:10.250228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 535/1076] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:45:10.274496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d7a4e-737b-4774-a5b5-0ad931f0a54d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:10.316254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:10.343830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5fa44-9995-403b-a28a-af81efbd44c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:10.384318 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55452547-5bf0-41c3-90c0-db701e2a0bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:10.385152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55452547-5bf0-41c3-90c0-db701e2a0bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:10.385436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55452547-5bf0-41c3-90c0-db701e2a0bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:10.385712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55452547-5bf0-41c3-90c0-db701e2a0bf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:10.392142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d7a4e-737b-4774-a5b5-0ad931f0a54d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:10.393923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55452547-5bf0-41c3-90c0-db701e2a0bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:10.394501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:10.396790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55452547-5bf0-41c3-90c0-db701e2a0bf1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-55452547-5bf0-41c3-90c0-db701e2a0bf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:45:10.411110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:10.413198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:10.414185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:45:10.414185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:45:10.414185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:45:10.414185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:45:10.414185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:45:10.414185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:45:10.414185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:45:10.414185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:10.414185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 542/1077] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:10.418310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55452547-5bf0-41c3-90c0-db701e2a0bf1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:10.433278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370c3e9-2964-4eef-99f6-8e4567b7201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:10.434797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c3e9-2964-4eef-99f6-8e4567b7201e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:10.435076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c3e9-2964-4eef-99f6-8e4567b7201e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:10.435348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c3e9-2964-4eef-99f6-8e4567b7201e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:10.448173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370c3e9-2964-4eef-99f6-8e4567b7201e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c370c3e9-2964-4eef-99f6-8e4567b7201e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:10.457018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:10.458806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:10.459909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 536/1078] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:10.465685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370c3e9-2964-4eef-99f6-8e4567b7201e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:10.545629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55452547-5bf0-41c3-90c0-db701e2a0bf1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:10.583169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b1a07-2d78-4a46-9af1-4dd0f5c4a7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:10.584150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b1a07-2d78-4a46-9af1-4dd0f5c4a7af None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:10.584430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b1a07-2d78-4a46-9af1-4dd0f5c4a7af None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:10.584711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b1a07-2d78-4a46-9af1-4dd0f5c4a7af None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:10.585058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370c3e9-2964-4eef-99f6-8e4567b7201e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:10.585505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b1a07-2d78-4a46-9af1-4dd0f5c4a7af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:10.585817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b1a07-2d78-4a46-9af1-4dd0f5c4a7af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:10.587366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b1a07-2d78-4a46-9af1-4dd0f5c4a7af None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:10.597329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:10.602145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 543/1079] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:10.608389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b1a07-2d78-4a46-9af1-4dd0f5c4a7af None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:10.632469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2f96a-d81d-46d1-8f2b-d6b52bb05850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:10.633166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f96a-d81d-46d1-8f2b-d6b52bb05850 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:10.633462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f96a-d81d-46d1-8f2b-d6b52bb05850 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:10.633749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2f96a-d81d-46d1-8f2b-d6b52bb05850 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:10.634544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2f96a-d81d-46d1-8f2b-d6b52bb05850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:10.634855 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2f96a-d81d-46d1-8f2b-d6b52bb05850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:10.636270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2f96a-d81d-46d1-8f2b-d6b52bb05850 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:10.645481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 537/1080] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:10.651314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2f96a-d81d-46d1-8f2b-d6b52bb05850 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:10.679502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:10.723176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b1a07-2d78-4a46-9af1-4dd0f5c4a7af None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:10.759394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2f96a-d81d-46d1-8f2b-d6b52bb05850 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:10.762651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f625cd-7e4e-473e-a427-93c1b46cf39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:10.763508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f625cd-7e4e-473e-a427-93c1b46cf39d None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:10.763790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f625cd-7e4e-473e-a427-93c1b46cf39d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:10.764070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f625cd-7e4e-473e-a427-93c1b46cf39d None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/09a967d14a7243068a016b4677e47234/roles/aa601cdd14964e958fd1ee007671e7f9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:10.766503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f625cd-7e4e-473e-a427-93c1b46cf39d None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=09a967d14a7243068a016b4677e47234, role_id=aa601cdd14964e958fd1ee007671e7f9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:10.767855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f625cd-7e4e-473e-a427-93c1b46cf39d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:10.786756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 544/1081] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:45:10 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/09a967d14a7243068a016b4677e47234/roles/aa601cdd14964e958fd1ee007671e7f9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:45:10.804426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b792-bc10-4fa2-8c7d-e8c633a61789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:10.805757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b792-bc10-4fa2-8c7d-e8c633a61789 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:10.806271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b792-bc10-4fa2-8c7d-e8c633a61789 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:10.806741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b792-bc10-4fa2-8c7d-e8c633a61789 None admin] PATH_INFO: `/v3/users/43da64bfa5b6489485b4f8bc266ca7a1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:10.809088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6b792-bc10-4fa2-8c7d-e8c633a61789 None admin] RBAC: Authorizing `identity:get_user(user_id=43da64bfa5b6489485b4f8bc266ca7a1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:10.811686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6b792-bc10-4fa2-8c7d-e8c633a61789 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:10.814903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 538/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:10 2022] GET /identity/v3/users/43da64bfa5b6489485b4f8bc266ca7a1 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:10.821833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f625cd-7e4e-473e-a427-93c1b46cf39d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:10.916011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:10.977753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f625cd-7e4e-473e-a427-93c1b46cf39d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:11.015472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de62440-2920-4094-8563-f2193637dd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:11.016373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de62440-2920-4094-8563-f2193637dd8b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:11.016649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de62440-2920-4094-8563-f2193637dd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:11.016922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de62440-2920-4094-8563-f2193637dd8b None admin] PATH_INFO: `/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:11.018138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de62440-2920-4094-8563-f2193637dd8b None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d5396cc664c72b3fc6df12ceeb86a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:11.019625 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de62440-2920-4094-8563-f2193637dd8b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:11.021437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 545/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:10 2022] GET /identity/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:11.027479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b792-bc10-4fa2-8c7d-e8c633a61789 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:11.123242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:11.134436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b792-bc10-4fa2-8c7d-e8c633a61789 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:11.172280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34055a3-4f2b-4af9-844a-1816bc8868db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:11.173253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34055a3-4f2b-4af9-844a-1816bc8868db None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:11.173538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34055a3-4f2b-4af9-844a-1816bc8868db None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:11.173819 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34055a3-4f2b-4af9-844a-1816bc8868db None admin] PATH_INFO: `/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a/users/43da64bfa5b6489485b4f8bc266ca7a1/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:11.176190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34055a3-4f2b-4af9-844a-1816bc8868db None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d5396cc664c72b3fc6df12ceeb86a, user_id=43da64bfa5b6489485b4f8bc266ca7a1, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:11.177811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34055a3-4f2b-4af9-844a-1816bc8868db None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:11.196289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 539/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:45:11 2022] PUT /identity/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a/users/43da64bfa5b6489485b4f8bc266ca7a1/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:45:13.432741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f35de-0512-47f6-a17e-63d3f92d63fb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:13.433334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f35de-0512-47f6-a17e-63d3f92d63fb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:13.433779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f35de-0512-47f6-a17e-63d3f92d63fb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:13.436271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 546/1085] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:13.442962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62062f5-fe83-460e-bfa0-ba99117ea088 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:13.443758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62062f5-fe83-460e-bfa0-ba99117ea088 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:13.443758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62062f5-fe83-460e-bfa0-ba99117ea088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:13.463770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d62062f5-fe83-460e-bfa0-ba99117ea088 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:13.465007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d62062f5-fe83-460e-bfa0-ba99117ea088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:13.549662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 540/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:13.576839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f35de-0512-47f6-a17e-63d3f92d63fb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:13.774681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f35de-0512-47f6-a17e-63d3f92d63fb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:13.805597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3fbc-b9f5-44cf-885a-4ee3b7f71eb8 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:13.806029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3fbc-b9f5-44cf-885a-4ee3b7f71eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:13.806446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3fbc-b9f5-44cf-885a-4ee3b7f71eb8 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:13.807977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 541/1087] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:45:13.813686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39068f-e7a6-42eb-aa5f-56688516700d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:13.814022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39068f-e7a6-42eb-aa5f-56688516700d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:13.814358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39068f-e7a6-42eb-aa5f-56688516700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:13.833125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:13.833320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fc39068f-e7a6-42eb-aa5f-56688516700d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:13.834856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fc39068f-e7a6-42eb-aa5f-56688516700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:13.846731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe099b1-e057-472a-b326-f2c4803a29ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:13.848091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe099b1-e057-472a-b326-f2c4803a29ed None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:13.848632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe099b1-e057-472a-b326-f2c4803a29ed None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:13.849111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe099b1-e057-472a-b326-f2c4803a29ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:13.867548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe099b1-e057-472a-b326-f2c4803a29ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-afe099b1-e057-472a-b326-f2c4803a29ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:13.876608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:13.878027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:13.879560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 547/1088] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 17 12:45:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:13.885384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe099b1-e057-472a-b326-f2c4803a29ed None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:13.923112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 542/1089] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:13.948342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39068f-e7a6-42eb-aa5f-56688516700d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:13.964887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:14.048944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe099b1-e057-472a-b326-f2c4803a29ed None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:14.084056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39068f-e7a6-42eb-aa5f-56688516700d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:14.094170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3c8e3-d529-4e85-be63-5184162b4284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:14.094868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3c8e3-d529-4e85-be63-5184162b4284 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:14.095152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3c8e3-d529-4e85-be63-5184162b4284 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:14.095431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3c8e3-d529-4e85-be63-5184162b4284 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:14.096189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3c8e3-d529-4e85-be63-5184162b4284 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:14.096493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3c8e3-d529-4e85-be63-5184162b4284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:14.097925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3c8e3-d529-4e85-be63-5184162b4284 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:14.107394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 548/1090] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 12:45:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:14.113765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3c8e3-d529-4e85-be63-5184162b4284 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:14.129979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232eee6-e874-4d10-8060-fdf8681bd234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:14.131454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232eee6-e874-4d10-8060-fdf8681bd234 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:14.131906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232eee6-e874-4d10-8060-fdf8681bd234 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:14.132388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232eee6-e874-4d10-8060-fdf8681bd234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:14.151595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232eee6-e874-4d10-8060-fdf8681bd234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:14.166640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3232eee6-e874-4d10-8060-fdf8681bd234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:14.167318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:14.168261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:14.169260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:14.169929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 543/1091] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:14.176271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232eee6-e874-4d10-8060-fdf8681bd234 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:14.248649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3c8e3-d529-4e85-be63-5184162b4284 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:14.265952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:14.289350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ceab5-7f34-472c-9245-d20808c9d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:14.290309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ceab5-7f34-472c-9245-d20808c9d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:14.290669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ceab5-7f34-472c-9245-d20808c9d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:14.290948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ceab5-7f34-472c-9245-d20808c9d2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:14.304129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232eee6-e874-4d10-8060-fdf8681bd234 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:14.308784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ceab5-7f34-472c-9245-d20808c9d2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:14.311353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ceab5-7f34-472c-9245-d20808c9d2d8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0a2ceab5-7f34-472c-9245-d20808c9d2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:45:14.331827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:14.332998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:14.334302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:45:14.334302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:45:14.334302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:14.334302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:14.334302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 549/1092] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:14.342178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ceab5-7f34-472c-9245-d20808c9d2d8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:14.366213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb84b5-6b03-406e-ae67-8cf00cb80a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:14.367413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb84b5-6b03-406e-ae67-8cf00cb80a0f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:14.367918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb84b5-6b03-406e-ae67-8cf00cb80a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:14.368400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb84b5-6b03-406e-ae67-8cf00cb80a0f None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:14.369847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb84b5-6b03-406e-ae67-8cf00cb80a0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:14.370445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb84b5-6b03-406e-ae67-8cf00cb80a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:14.373108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb84b5-6b03-406e-ae67-8cf00cb80a0f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:14.387174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 544/1093] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:45:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:14.393814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb84b5-6b03-406e-ae67-8cf00cb80a0f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:14.485029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ceab5-7f34-472c-9245-d20808c9d2d8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:14.486994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:14.511491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb84b5-6b03-406e-ae67-8cf00cb80a0f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:14.549262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4c37d-fada-4b1f-b68a-4b8b573d7059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:14.549548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd287d63-06c3-4804-8075-761b37ac1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:14.550462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd287d63-06c3-4804-8075-761b37ac1698 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:14.550761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c37d-fada-4b1f-b68a-4b8b573d7059 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:14.550890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd287d63-06c3-4804-8075-761b37ac1698 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:14.550996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c37d-fada-4b1f-b68a-4b8b573d7059 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:14.551079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd287d63-06c3-4804-8075-761b37ac1698 None admin] PATH_INFO: `/v3/users/43da64bfa5b6489485b4f8bc266ca7a1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:14.551332 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4c37d-fada-4b1f-b68a-4b8b573d7059 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:14.552346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd287d63-06c3-4804-8075-761b37ac1698 None admin] RBAC: Authorizing `identity:get_user(user_id=43da64bfa5b6489485b4f8bc266ca7a1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:14.553319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4c37d-fada-4b1f-b68a-4b8b573d7059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:14.553319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4c37d-fada-4b1f-b68a-4b8b573d7059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:14.553835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd287d63-06c3-4804-8075-761b37ac1698 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:14.555626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 545/1094] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:14 2022] GET /identity/v3/users/43da64bfa5b6489485b4f8bc266ca7a1 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:14.561143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4c37d-fada-4b1f-b68a-4b8b573d7059 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:14.562191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd287d63-06c3-4804-8075-761b37ac1698 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:14.565956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:14.578431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 550/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:14.585168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4c37d-fada-4b1f-b68a-4b8b573d7059 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:14.708467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd287d63-06c3-4804-8075-761b37ac1698 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:14.709482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4c37d-fada-4b1f-b68a-4b8b573d7059 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:14.752176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d4aa-5d6a-4900-b462-908326fac24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:14.752867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d4aa-5d6a-4900-b462-908326fac24f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:14.753152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d4aa-5d6a-4900-b462-908326fac24f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:14.753498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d4aa-5d6a-4900-b462-908326fac24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:14.777099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382108b-bff7-4d93-8d41-1e333da7c1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:14.780796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382108b-bff7-4d93-8d41-1e333da7c1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:14.780796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382108b-bff7-4d93-8d41-1e333da7c1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:14.780796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382108b-bff7-4d93-8d41-1e333da7c1b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:14.793269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382108b-bff7-4d93-8d41-1e333da7c1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:14.796070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382108b-bff7-4d93-8d41-1e333da7c1b6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8382108b-bff7-4d93-8d41-1e333da7c1b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:45:14.824988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:14.826795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:14.828525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 551/1096] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 17 12:45:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:14.835714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382108b-bff7-4d93-8d41-1e333da7c1b6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:14.839825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675d4aa-5d6a-4900-b462-908326fac24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:14.841329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675d4aa-5d6a-4900-b462-908326fac24f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:14.843736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:14.883376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:14.992367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382108b-bff7-4d93-8d41-1e333da7c1b6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:15.001429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 546/1097] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 12:45:15.007968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d4aa-5d6a-4900-b462-908326fac24f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:15.043479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd97b5-d31e-404f-8280-90562f9dc227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:15.043957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd97b5-d31e-404f-8280-90562f9dc227 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:15.044285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd97b5-d31e-404f-8280-90562f9dc227 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:15.045225 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd97b5-d31e-404f-8280-90562f9dc227 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:15.045512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd97b5-d31e-404f-8280-90562f9dc227 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:15.045836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd97b5-d31e-404f-8280-90562f9dc227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:15.047483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd97b5-d31e-404f-8280-90562f9dc227 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:15.070144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 552/1098] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 17 12:45:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:15.076331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd97b5-d31e-404f-8280-90562f9dc227 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:15.158907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d4aa-5d6a-4900-b462-908326fac24f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:15.160730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:15.190322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:15.205706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be3f9e-1483-438f-86a1-38e841f8bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:15.206758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be3f9e-1483-438f-86a1-38e841f8bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:15.207157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be3f9e-1483-438f-86a1-38e841f8bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:15.207550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be3f9e-1483-438f-86a1-38e841f8bfa8 None admin] PATH_INFO: `/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:15.209438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be3f9e-1483-438f-86a1-38e841f8bfa8 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d5396cc664c72b3fc6df12ceeb86a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:15.211103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be3f9e-1483-438f-86a1-38e841f8bfa8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:15.213825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 547/1099] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:15 2022] GET /identity/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:15.220949 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be3f9e-1483-438f-86a1-38e841f8bfa8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:15.221552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd97b5-d31e-404f-8280-90562f9dc227 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:15.269438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd937-c75c-41a6-b2f8-7e3878c90a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:15.270456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd937-c75c-41a6-b2f8-7e3878c90a69 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:15.270945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd937-c75c-41a6-b2f8-7e3878c90a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:15.271434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd937-c75c-41a6-b2f8-7e3878c90a69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:15.362285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcd937-c75c-41a6-b2f8-7e3878c90a69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:15.365179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcd937-c75c-41a6-b2f8-7e3878c90a69 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:15.371336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be3f9e-1483-438f-86a1-38e841f8bfa8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:15.422792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049fb6d-184d-4eda-b753-c2be3927e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:15.423359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049fb6d-184d-4eda-b753-c2be3927e0fd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:15.423736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049fb6d-184d-4eda-b753-c2be3927e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:15.424011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049fb6d-184d-4eda-b753-c2be3927e0fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:15.424872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049fb6d-184d-4eda-b753-c2be3927e0fd None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=6b4d5396cc664c72b3fc6df12ceeb86a, user.id=43da64bfa5b6489485b4f8bc266ca7a1) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:15.425171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049fb6d-184d-4eda-b753-c2be3927e0fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:15.426783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049fb6d-184d-4eda-b753-c2be3927e0fd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:15.433820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 548/1100] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:45:15 2022] GET /identity/v3/role_assignments?user.id=43da64bfa5b6489485b4f8bc266ca7a1&scope.project.id=6b4d5396cc664c72b3fc6df12ceeb86a&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:15.500842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:15.535859 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 553/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 12:45:15.546072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049fb6d-184d-4eda-b753-c2be3927e0fd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:15.598929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:15.697128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049fb6d-184d-4eda-b753-c2be3927e0fd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:15.758779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cadaa9-443d-45ff-8495-b6def2ab5ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:15.760231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cadaa9-443d-45ff-8495-b6def2ab5ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:15.760768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cadaa9-443d-45ff-8495-b6def2ab5ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:15.761275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cadaa9-443d-45ff-8495-b6def2ab5ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:15.781760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cadaa9-443d-45ff-8495-b6def2ab5ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:15.784611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cadaa9-443d-45ff-8495-b6def2ab5ba9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-42cadaa9-443d-45ff-8495-b6def2ab5ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:45:15.820080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:15.821518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:15.823154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:45:15.823154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:45:15.823154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:45:15.823154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:15.823154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 549/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:15.828501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd937-c75c-41a6-b2f8-7e3878c90a69 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:15.947444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd937-c75c-41a6-b2f8-7e3878c90a69 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:15.983618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329c16f-0e70-41c5-8016-9e32906ea73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:15.984293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329c16f-0e70-41c5-8016-9e32906ea73a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:15.984570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329c16f-0e70-41c5-8016-9e32906ea73a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:15.984843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329c16f-0e70-41c5-8016-9e32906ea73a None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:15.985606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329c16f-0e70-41c5-8016-9e32906ea73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:15.985910 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329c16f-0e70-41c5-8016-9e32906ea73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:15.987364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329c16f-0e70-41c5-8016-9e32906ea73a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:16.000216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 554/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:16.008487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cadaa9-443d-45ff-8495-b6def2ab5ba9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:16.099770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:16.116094 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cadaa9-443d-45ff-8495-b6def2ab5ba9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:16.157428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e69ec6-4f16-4d90-8a46-410bbf257ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:16.158343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69ec6-4f16-4d90-8a46-410bbf257ebc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:16.158627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69ec6-4f16-4d90-8a46-410bbf257ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:16.158876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69ec6-4f16-4d90-8a46-410bbf257ebc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:16.170007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e69ec6-4f16-4d90-8a46-410bbf257ebc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:16.171556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e69ec6-4f16-4d90-8a46-410bbf257ebc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b6e69ec6-4f16-4d90-8a46-410bbf257ebc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:45:16.188096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:16.189108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:16.190165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:45:16.190165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:45:16.190165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:45:16.190165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:45:16.190165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:45:16.190165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:45:16.190165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:45:16.190165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:16.190165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 550/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:16.196655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329c16f-0e70-41c5-8016-9e32906ea73a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:16.268284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:16.344577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329c16f-0e70-41c5-8016-9e32906ea73a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:16.393374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972ff38-6526-4f46-8fc1-6207d1157378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:16.394118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972ff38-6526-4f46-8fc1-6207d1157378 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:16.394401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972ff38-6526-4f46-8fc1-6207d1157378 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:16.394674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972ff38-6526-4f46-8fc1-6207d1157378 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:16.395865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972ff38-6526-4f46-8fc1-6207d1157378 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:16.396174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972ff38-6526-4f46-8fc1-6207d1157378 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:16.397683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972ff38-6526-4f46-8fc1-6207d1157378 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:16.412006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 555/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:16.418446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e69ec6-4f16-4d90-8a46-410bbf257ebc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:16.546354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e69ec6-4f16-4d90-8a46-410bbf257ebc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:16.591781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d68af-424e-49d0-acf2-e98b5144e8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:16.592472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d68af-424e-49d0-acf2-e98b5144e8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:16.592786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d68af-424e-49d0-acf2-e98b5144e8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:16.593148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d68af-424e-49d0-acf2-e98b5144e8b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:16.594131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d68af-424e-49d0-acf2-e98b5144e8b1 None admin] RBAC: Adding query filter params (role.id=aa601cdd14964e958fd1ee007671e7f9, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=09a967d14a7243068a016b4677e47234) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:16.594456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d68af-424e-49d0-acf2-e98b5144e8b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:16.595966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d68af-424e-49d0-acf2-e98b5144e8b1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:16.618135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 551/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:45:16 2022] GET /identity/v3/role_assignments?user.id=09a967d14a7243068a016b4677e47234&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=aa601cdd14964e958fd1ee007671e7f9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:17.958082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c65c9-ce29-4541-aad8-f1f111ca1ba5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:17.958842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c65c9-ce29-4541-aad8-f1f111ca1ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:17.958842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c65c9-ce29-4541-aad8-f1f111ca1ba5 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:17.960217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 556/1107] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:17.966659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcef8bc-06a7-412d-a4d4-14f69393158e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:17.967214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcef8bc-06a7-412d-a4d4-14f69393158e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:17.967336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcef8bc-06a7-412d-a4d4-14f69393158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:17.985199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-afcef8bc-06a7-412d-a4d4-14f69393158e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:17.986460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afcef8bc-06a7-412d-a4d4-14f69393158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:17.990064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:18.058484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 552/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:18.083736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c65c9-ce29-4541-aad8-f1f111ca1ba5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:18.199754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:18.204359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c65c9-ce29-4541-aad8-f1f111ca1ba5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:18.241419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe3af1-d19c-4ecf-9cce-b36dd32f859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:18.242185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe3af1-d19c-4ecf-9cce-b36dd32f859c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:18.242466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe3af1-d19c-4ecf-9cce-b36dd32f859c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:18.242734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe3af1-d19c-4ecf-9cce-b36dd32f859c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:18.243952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe3af1-d19c-4ecf-9cce-b36dd32f859c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:18.245422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe3af1-d19c-4ecf-9cce-b36dd32f859c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:18.247100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 557/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:18.253435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcef8bc-06a7-412d-a4d4-14f69393158e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:18.364862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcef8bc-06a7-412d-a4d4-14f69393158e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:18.403308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4f8cd-e295-45aa-ae4c-84cc88df3848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:18.404077 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f8cd-e295-45aa-ae4c-84cc88df3848 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:18.404273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f8cd-e295-45aa-ae4c-84cc88df3848 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:18.404620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f8cd-e295-45aa-ae4c-84cc88df3848 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:18.405269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4f8cd-e295-45aa-ae4c-84cc88df3848 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:18.406788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4f8cd-e295-45aa-ae4c-84cc88df3848 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:18.417072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:18.431155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 553/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:45:18 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:45:20.670595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ead8bf-4b4e-48ce-ab5b-6bff86bf58a7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:20.671185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ead8bf-4b4e-48ce-ab5b-6bff86bf58a7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:20.671185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ead8bf-4b4e-48ce-ab5b-6bff86bf58a7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:20.672528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 558/1111] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:20.677988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8e062-d934-4f0f-80cd-ae7f3fe7ef8f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:20.678468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8e062-d934-4f0f-80cd-ae7f3fe7ef8f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:20.678909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8e062-d934-4f0f-80cd-ae7f3fe7ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:20.696656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-05a8e062-d934-4f0f-80cd-ae7f3fe7ef8f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:20.697861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-05a8e062-d934-4f0f-80cd-ae7f3fe7ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:20.771664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 554/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:20.796119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ead8bf-4b4e-48ce-ab5b-6bff86bf58a7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:20.908672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ead8bf-4b4e-48ce-ab5b-6bff86bf58a7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:20.951131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9ec88-f837-49fa-b3e6-5be989868058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:20.951937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9ec88-f837-49fa-b3e6-5be989868058 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:20.952215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9ec88-f837-49fa-b3e6-5be989868058 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:20.952484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9ec88-f837-49fa-b3e6-5be989868058 None admin] PATH_INFO: `/v3/roles/1a772cde30724b09b110b5dffecfd462` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:20.954142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9ec88-f837-49fa-b3e6-5be989868058 None admin] RBAC: Authorizing `identity:get_role(role_id=1a772cde30724b09b110b5dffecfd462)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:20.955605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9ec88-f837-49fa-b3e6-5be989868058 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:20.957074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 559/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:20 2022] GET /identity/v3/roles/1a772cde30724b09b110b5dffecfd462 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:20.963836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8e062-d934-4f0f-80cd-ae7f3fe7ef8f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:21.079998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8e062-d934-4f0f-80cd-ae7f3fe7ef8f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:21.109090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:21.120158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe69c3-8aad-4d3b-87b8-a7dff56e15b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:21.121085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe69c3-8aad-4d3b-87b8-a7dff56e15b6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:21.121366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe69c3-8aad-4d3b-87b8-a7dff56e15b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:21.121638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe69c3-8aad-4d3b-87b8-a7dff56e15b6 None admin] PATH_INFO: `/v3/users/7b6a23b72e2948cdbfc0258ecb7f5e7e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:21.137945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe69c3-8aad-4d3b-87b8-a7dff56e15b6 None admin] RBAC: Authorizing `identity:get_user(user_id=7b6a23b72e2948cdbfc0258ecb7f5e7e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:21.139488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe69c3-8aad-4d3b-87b8-a7dff56e15b6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:21.141314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 555/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:20 2022] GET /identity/v3/users/7b6a23b72e2948cdbfc0258ecb7f5e7e => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:21.148034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9ec88-f837-49fa-b3e6-5be989868058 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:21.190129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:21.267124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9ec88-f837-49fa-b3e6-5be989868058 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:21.305546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993329d2-6de5-487d-af04-7751b439f5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:21.306265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993329d2-6de5-487d-af04-7751b439f5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:21.306551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993329d2-6de5-487d-af04-7751b439f5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:21.306831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993329d2-6de5-487d-af04-7751b439f5d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:21.389922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993329d2-6de5-487d-af04-7751b439f5d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:21.391470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993329d2-6de5-487d-af04-7751b439f5d3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:21.427440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:21.505178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 560/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:21.511845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe69c3-8aad-4d3b-87b8-a7dff56e15b6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:21.635456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe69c3-8aad-4d3b-87b8-a7dff56e15b6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:21.672708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9045e7-3eea-4238-b5fc-dcc1019e75a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:21.673607 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9045e7-3eea-4238-b5fc-dcc1019e75a7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:21.673889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9045e7-3eea-4238-b5fc-dcc1019e75a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:21.674193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9045e7-3eea-4238-b5fc-dcc1019e75a7 None admin] PATH_INFO: `/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:21.675408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9045e7-3eea-4238-b5fc-dcc1019e75a7 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d5396cc664c72b3fc6df12ceeb86a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:21.677061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9045e7-3eea-4238-b5fc-dcc1019e75a7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:21.678856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 556/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:21 2022] GET /identity/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:21.687268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993329d2-6de5-487d-af04-7751b439f5d3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:21.798111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993329d2-6de5-487d-af04-7751b439f5d3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:21.838659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de63d3b-ddbb-483e-b2a7-ec0c826ce915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:21.839774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de63d3b-ddbb-483e-b2a7-ec0c826ce915 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:21.840254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de63d3b-ddbb-483e-b2a7-ec0c826ce915 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:21.840560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de63d3b-ddbb-483e-b2a7-ec0c826ce915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:21.841649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de63d3b-ddbb-483e-b2a7-ec0c826ce915 None admin] RBAC: Adding query filter params (role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=6b4d5396cc664c72b3fc6df12ceeb86a, user.id=7b6a23b72e2948cdbfc0258ecb7f5e7e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:21.841973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de63d3b-ddbb-483e-b2a7-ec0c826ce915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:21.843487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de63d3b-ddbb-483e-b2a7-ec0c826ce915 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:21.846985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:21.852638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 561/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:45:21 2022] GET /identity/v3/role_assignments?user.id=7b6a23b72e2948cdbfc0258ecb7f5e7e&scope.project.id=6b4d5396cc664c72b3fc6df12ceeb86a&role.id=1a772cde30724b09b110b5dffecfd462 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:24.085980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e616414-6dde-4506-9169-899ad337f2d7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:24.086746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e616414-6dde-4506-9169-899ad337f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:24.086746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e616414-6dde-4506-9169-899ad337f2d7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:24.088066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 557/1118] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:24.098013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c2e1-23a8-4790-bab2-cb1fc9c8a39f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:24.098654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c2e1-23a8-4790-bab2-cb1fc9c8a39f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:24.099030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c2e1-23a8-4790-bab2-cb1fc9c8a39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:24.128457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-35f8c2e1-23a8-4790-bab2-cb1fc9c8a39f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:24.130634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-35f8c2e1-23a8-4790-bab2-cb1fc9c8a39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:24.250078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 562/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:24.289749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e616414-6dde-4506-9169-899ad337f2d7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:24.354660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:24.437052 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e616414-6dde-4506-9169-899ad337f2d7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:24.495118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae50e1-522b-4485-a33b-0759cba97624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:24.496714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae50e1-522b-4485-a33b-0759cba97624 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:24.497194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae50e1-522b-4485-a33b-0759cba97624 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:24.497664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae50e1-522b-4485-a33b-0759cba97624 None admin] PATH_INFO: `/v3/roles/1a772cde30724b09b110b5dffecfd462` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:24.500046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae50e1-522b-4485-a33b-0759cba97624 None admin] RBAC: Authorizing `identity:get_role(role_id=1a772cde30724b09b110b5dffecfd462)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:24.502609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae50e1-522b-4485-a33b-0759cba97624 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:24.505298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 558/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:24 2022] GET /identity/v3/roles/1a772cde30724b09b110b5dffecfd462 => generated 223 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:24.511448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8c2e1-23a8-4790-bab2-cb1fc9c8a39f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:24.620524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8c2e1-23a8-4790-bab2-cb1fc9c8a39f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:24.651069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:24.658593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0da78f-2d3e-41a8-8bf7-cd3a5ee97ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:24.659498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0da78f-2d3e-41a8-8bf7-cd3a5ee97ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:24.659797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0da78f-2d3e-41a8-8bf7-cd3a5ee97ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:24.660074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0da78f-2d3e-41a8-8bf7-cd3a5ee97ca9 None admin] PATH_INFO: `/v3/users/7b6a23b72e2948cdbfc0258ecb7f5e7e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:24.661318 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0da78f-2d3e-41a8-8bf7-cd3a5ee97ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=7b6a23b72e2948cdbfc0258ecb7f5e7e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:24.662852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0da78f-2d3e-41a8-8bf7-cd3a5ee97ca9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:24.664496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 563/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:24 2022] GET /identity/v3/users/7b6a23b72e2948cdbfc0258ecb7f5e7e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:24.670574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae50e1-522b-4485-a33b-0759cba97624 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:24.778624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae50e1-522b-4485-a33b-0759cba97624 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:24.801159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:24.817390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f6f5d-830b-4b8f-97d5-1d82ba3b05a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:24.818362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f6f5d-830b-4b8f-97d5-1d82ba3b05a3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:24.818639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f6f5d-830b-4b8f-97d5-1d82ba3b05a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:24.818904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f6f5d-830b-4b8f-97d5-1d82ba3b05a3 None admin] PATH_INFO: `/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:24.820138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f6f5d-830b-4b8f-97d5-1d82ba3b05a3 None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d5396cc664c72b3fc6df12ceeb86a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:24.821594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f6f5d-830b-4b8f-97d5-1d82ba3b05a3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:24.823351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 559/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:24 2022] GET /identity/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:24.829764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0da78f-2d3e-41a8-8bf7-cd3a5ee97ca9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:24.939298 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0da78f-2d3e-41a8-8bf7-cd3a5ee97ca9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:24.975638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db41da-6094-4c3f-9d90-635577402d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:24.976555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db41da-6094-4c3f-9d90-635577402d75 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:24.976887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db41da-6094-4c3f-9d90-635577402d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:24.977111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db41da-6094-4c3f-9d90-635577402d75 None admin] PATH_INFO: `/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a/users/7b6a23b72e2948cdbfc0258ecb7f5e7e/roles/1a772cde30724b09b110b5dffecfd462` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:24.979353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db41da-6094-4c3f-9d90-635577402d75 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b4d5396cc664c72b3fc6df12ceeb86a, user_id=7b6a23b72e2948cdbfc0258ecb7f5e7e, role_id=1a772cde30724b09b110b5dffecfd462)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:24.980851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db41da-6094-4c3f-9d90-635577402d75 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:24.997611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 564/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:45:24 2022] PUT /identity/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a/users/7b6a23b72e2948cdbfc0258ecb7f5e7e/roles/1a772cde30724b09b110b5dffecfd462 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:45:27.175450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0b53f-4d0c-4b89-a45f-a155867eb35e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:27.176091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0b53f-4d0c-4b89-a45f-a155867eb35e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:27.176523 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0b53f-4d0c-4b89-a45f-a155867eb35e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:27.179182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 560/1124] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:27.185148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0f408-54e2-4ab5-83a1-4320dd2cf32e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:27.185821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0f408-54e2-4ab5-83a1-4320dd2cf32e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:27.185821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0f408-54e2-4ab5-83a1-4320dd2cf32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:27.203077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-52d0f408-54e2-4ab5-83a1-4320dd2cf32e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:27.204268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-52d0f408-54e2-4ab5-83a1-4320dd2cf32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:27.259655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:27.275144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 565/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:45:27.299495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0b53f-4d0c-4b89-a45f-a155867eb35e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:27.407695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0b53f-4d0c-4b89-a45f-a155867eb35e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:27.445323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373f1c-e296-41e7-9e30-7cc4a68365fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:27.446314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373f1c-e296-41e7-9e30-7cc4a68365fe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:27.446687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373f1c-e296-41e7-9e30-7cc4a68365fe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:27.447047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373f1c-e296-41e7-9e30-7cc4a68365fe None admin] PATH_INFO: `/v3/roles/1a772cde30724b09b110b5dffecfd462` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:27.448658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b373f1c-e296-41e7-9e30-7cc4a68365fe None admin] RBAC: Authorizing `identity:get_role(role_id=1a772cde30724b09b110b5dffecfd462)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:27.450189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b373f1c-e296-41e7-9e30-7cc4a68365fe None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:27.451618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 561/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:27 2022] GET /identity/v3/roles/1a772cde30724b09b110b5dffecfd462 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:27.457840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0f408-54e2-4ab5-83a1-4320dd2cf32e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:27.572388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0f408-54e2-4ab5-83a1-4320dd2cf32e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:27.611996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188114e7-ede1-4e10-b6a0-984b3a0f4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:27.612990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188114e7-ede1-4e10-b6a0-984b3a0f4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:27.613389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188114e7-ede1-4e10-b6a0-984b3a0f4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:27.614072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188114e7-ede1-4e10-b6a0-984b3a0f4ca6 None admin] PATH_INFO: `/v3/users/7b6a23b72e2948cdbfc0258ecb7f5e7e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:27.615543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188114e7-ede1-4e10-b6a0-984b3a0f4ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=7b6a23b72e2948cdbfc0258ecb7f5e7e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:27.617074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188114e7-ede1-4e10-b6a0-984b3a0f4ca6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:27.618759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 566/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:27 2022] GET /identity/v3/users/7b6a23b72e2948cdbfc0258ecb7f5e7e => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:27.625047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373f1c-e296-41e7-9e30-7cc4a68365fe None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:27.689524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:27.740583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373f1c-e296-41e7-9e30-7cc4a68365fe None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:27.783911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf635b2-7c4b-4e3a-a05e-fb5cc36d5be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:27.784638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf635b2-7c4b-4e3a-a05e-fb5cc36d5be6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:27.784917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf635b2-7c4b-4e3a-a05e-fb5cc36d5be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:27.785191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf635b2-7c4b-4e3a-a05e-fb5cc36d5be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:27.887312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf635b2-7c4b-4e3a-a05e-fb5cc36d5be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:27.888816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf635b2-7c4b-4e3a-a05e-fb5cc36d5be6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:27.948679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:27.996127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 562/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:28.002213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188114e7-ede1-4e10-b6a0-984b3a0f4ca6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:28.059715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:28.105901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188114e7-ede1-4e10-b6a0-984b3a0f4ca6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:28.142296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b55253-1e84-4fe5-8259-cd53ec7d01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:28.143182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b55253-1e84-4fe5-8259-cd53ec7d01bf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:28.143468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b55253-1e84-4fe5-8259-cd53ec7d01bf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:28.143742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b55253-1e84-4fe5-8259-cd53ec7d01bf None admin] PATH_INFO: `/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:28.144941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b55253-1e84-4fe5-8259-cd53ec7d01bf None admin] RBAC: Authorizing `identity:get_project(project_id=6b4d5396cc664c72b3fc6df12ceeb86a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:28.146708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b55253-1e84-4fe5-8259-cd53ec7d01bf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:28.148458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 567/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:28 2022] GET /identity/v3/projects/6b4d5396cc664c72b3fc6df12ceeb86a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:28.155036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf635b2-7c4b-4e3a-a05e-fb5cc36d5be6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:28.271570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf635b2-7c4b-4e3a-a05e-fb5cc36d5be6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:28.313113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfba4dc-adec-4132-a5dc-8f85e743963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:28.313794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfba4dc-adec-4132-a5dc-8f85e743963c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:28.314074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfba4dc-adec-4132-a5dc-8f85e743963c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:28.314439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfba4dc-adec-4132-a5dc-8f85e743963c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:28.315214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfba4dc-adec-4132-a5dc-8f85e743963c None admin] RBAC: Adding query filter params (role.id=1a772cde30724b09b110b5dffecfd462, scope.project.id=6b4d5396cc664c72b3fc6df12ceeb86a, user.id=7b6a23b72e2948cdbfc0258ecb7f5e7e) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:28.315528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfba4dc-adec-4132-a5dc-8f85e743963c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:28.317043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfba4dc-adec-4132-a5dc-8f85e743963c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:28.323701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 563/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:45:28 2022] GET /identity/v3/role_assignments?user.id=7b6a23b72e2948cdbfc0258ecb7f5e7e&scope.project.id=6b4d5396cc664c72b3fc6df12ceeb86a&role.id=1a772cde30724b09b110b5dffecfd462 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:30.543427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e215a-52d3-4ba9-8495-dbdf804c626e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:30.544085 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e215a-52d3-4ba9-8495-dbdf804c626e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:30.544396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e215a-52d3-4ba9-8495-dbdf804c626e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:30.545961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 568/1131] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:30.553121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f840f22-5feb-49fa-bce8-7fafddda88a5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:30.553733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f840f22-5feb-49fa-bce8-7fafddda88a5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:30.553733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f840f22-5feb-49fa-bce8-7fafddda88a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:30.571712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9f840f22-5feb-49fa-bce8-7fafddda88a5 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:30.572907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9f840f22-5feb-49fa-bce8-7fafddda88a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:30.589298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:30.649640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 564/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:30.673660 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e215a-52d3-4ba9-8495-dbdf804c626e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:30.784276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e215a-52d3-4ba9-8495-dbdf804c626e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:30.812464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:30.824998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbe040-2146-497f-aec9-6252d02b4ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:30.825741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbe040-2146-497f-aec9-6252d02b4ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:30.826014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbe040-2146-497f-aec9-6252d02b4ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:30.826391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbe040-2146-497f-aec9-6252d02b4ba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:30.827621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbe040-2146-497f-aec9-6252d02b4ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:30.829108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbe040-2146-497f-aec9-6252d02b4ba2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:30.830787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 569/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:30.840266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f840f22-5feb-49fa-bce8-7fafddda88a5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:30.971881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f840f22-5feb-49fa-bce8-7fafddda88a5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:31.008309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce9bf3-83e3-4cfa-850e-f15439d3c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:31.008983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9bf3-83e3-4cfa-850e-f15439d3c51c None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:31.009262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9bf3-83e3-4cfa-850e-f15439d3c51c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:31.009533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9bf3-83e3-4cfa-850e-f15439d3c51c None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:31.010295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce9bf3-83e3-4cfa-850e-f15439d3c51c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:31.011756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce9bf3-83e3-4cfa-850e-f15439d3c51c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:31.040140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 565/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:45:30 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:45:33.293647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cb1bf-5cb4-4f18-b873-481d00fef8a6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:33.294243 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cb1bf-5cb4-4f18-b873-481d00fef8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:33.294243 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cb1bf-5cb4-4f18-b873-481d00fef8a6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:33.295735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 570/1135] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:33.301653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c009bd-ab5b-4d52-a424-8851f4a12605 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:33.302402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c009bd-ab5b-4d52-a424-8851f4a12605 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:33.302402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c009bd-ab5b-4d52-a424-8851f4a12605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:33.307835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:33.322557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-28c009bd-ab5b-4d52-a424-8851f4a12605 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:33.323786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-28c009bd-ab5b-4d52-a424-8851f4a12605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:33.397364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 566/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:45:33.422234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cb1bf-5cb4-4f18-b873-481d00fef8a6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:33.529158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cb1bf-5cb4-4f18-b873-481d00fef8a6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:33.569349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a011a-e869-4041-b942-a21c4a13ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:33.570106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a011a-e869-4041-b942-a21c4a13ab48 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:33.570412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a011a-e869-4041-b942-a21c4a13ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:33.570679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a011a-e869-4041-b942-a21c4a13ab48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:33.571902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a011a-e869-4041-b942-a21c4a13ab48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:33.573397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a011a-e869-4041-b942-a21c4a13ab48 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:33.575107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 571/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:45:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:33.581087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c009bd-ab5b-4d52-a424-8851f4a12605 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:33.691096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c009bd-ab5b-4d52-a424-8851f4a12605 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:33.722012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:33.728189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6940eb6-4b94-461a-a5ef-eef96c8ab5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:33.728889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6940eb6-4b94-461a-a5ef-eef96c8ab5b8 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:33.729176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6940eb6-4b94-461a-a5ef-eef96c8ab5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:33.729456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6940eb6-4b94-461a-a5ef-eef96c8ab5b8 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:33.730219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6940eb6-4b94-461a-a5ef-eef96c8ab5b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:33.731687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6940eb6-4b94-461a-a5ef-eef96c8ab5b8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:33.756389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 567/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:45:33 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:45:36.046718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52b927-2412-426b-9022-30ad8edd0eea None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:36.047539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52b927-2412-426b-9022-30ad8edd0eea None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:36.047539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52b927-2412-426b-9022-30ad8edd0eea None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:36.048660 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 572/1139] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:36.054911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec643f-5b95-4da0-8822-fd37efc63d21 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:36.055720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec643f-5b95-4da0-8822-fd37efc63d21 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:36.055894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec643f-5b95-4da0-8822-fd37efc63d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:36.073936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e1ec643f-5b95-4da0-8822-fd37efc63d21 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:36.075188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e1ec643f-5b95-4da0-8822-fd37efc63d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:36.148708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 568/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:36.186082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52b927-2412-426b-9022-30ad8edd0eea None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:36.291577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:36.339757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52b927-2412-426b-9022-30ad8edd0eea None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:36.382295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599343b-e70e-48c0-912a-c4ff91720698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:36.383173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599343b-e70e-48c0-912a-c4ff91720698 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:36.383453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599343b-e70e-48c0-912a-c4ff91720698 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:36.383728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599343b-e70e-48c0-912a-c4ff91720698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:36.397262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599343b-e70e-48c0-912a-c4ff91720698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1599343b-e70e-48c0-912a-c4ff91720698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:36.405890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:36.407411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:36.408612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 573/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:45:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:36.414988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec643f-5b95-4da0-8822-fd37efc63d21 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:36.536287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec643f-5b95-4da0-8822-fd37efc63d21 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:36.556691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:36.576517 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f7535-6086-41c0-b3c8-eee807168fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:36.577121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f7535-6086-41c0-b3c8-eee807168fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:36.577407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f7535-6086-41c0-b3c8-eee807168fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:36.577688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f7535-6086-41c0-b3c8-eee807168fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:36.578499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f7535-6086-41c0-b3c8-eee807168fd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:36.578821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f7535-6086-41c0-b3c8-eee807168fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:36.580235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f7535-6086-41c0-b3c8-eee807168fd0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:36.589642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 569/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:45:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:36.598409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599343b-e70e-48c0-912a-c4ff91720698 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:36.712174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599343b-e70e-48c0-912a-c4ff91720698 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:36.734701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:36.752660 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac072c-0b09-4739-85cd-6b5dc55aa138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:36.753571 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac072c-0b09-4739-85cd-6b5dc55aa138 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:36.753848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac072c-0b09-4739-85cd-6b5dc55aa138 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:36.754139 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac072c-0b09-4739-85cd-6b5dc55aa138 None admin] PATH_INFO: `/v3/users/6bff18dd54594fcc8436b62730738989` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:36.770426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac072c-0b09-4739-85cd-6b5dc55aa138 None admin] RBAC: Authorizing `identity:get_user(user_id=6bff18dd54594fcc8436b62730738989)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:36.771942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac072c-0b09-4739-85cd-6b5dc55aa138 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:36.773681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 574/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:36 2022] GET /identity/v3/users/6bff18dd54594fcc8436b62730738989 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:36.780214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f7535-6086-41c0-b3c8-eee807168fd0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:36.893974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f7535-6086-41c0-b3c8-eee807168fd0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:36.932542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bdbbe-1018-4216-813c-93056c46a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:36.933214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bdbbe-1018-4216-813c-93056c46a4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:36.933497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bdbbe-1018-4216-813c-93056c46a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:36.933773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bdbbe-1018-4216-813c-93056c46a4e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:36.987983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:37.010901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bdbbe-1018-4216-813c-93056c46a4e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:37.012395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bdbbe-1018-4216-813c-93056c46a4e6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:37.117928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 570/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:37.124560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac072c-0b09-4739-85cd-6b5dc55aa138 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:37.227811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac072c-0b09-4739-85cd-6b5dc55aa138 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:37.263689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13086be3-44e8-4fcc-94b4-ad7182e3a703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:37.264579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086be3-44e8-4fcc-94b4-ad7182e3a703 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:37.264857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086be3-44e8-4fcc-94b4-ad7182e3a703 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:37.265163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13086be3-44e8-4fcc-94b4-ad7182e3a703 None admin] PATH_INFO: `/v3/projects/288991c7ac3047c09830fd2e111c1f15` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:37.266458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13086be3-44e8-4fcc-94b4-ad7182e3a703 None admin] RBAC: Authorizing `identity:get_project(project_id=288991c7ac3047c09830fd2e111c1f15)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:37.267973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13086be3-44e8-4fcc-94b4-ad7182e3a703 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:37.269670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 575/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:37 2022] GET /identity/v3/projects/288991c7ac3047c09830fd2e111c1f15 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:37.276342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bdbbe-1018-4216-813c-93056c46a4e6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:37.361423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:37.386530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bdbbe-1018-4216-813c-93056c46a4e6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:37.424518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03994640-1ca7-4fd2-9d5b-90038b13a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:37.425261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994640-1ca7-4fd2-9d5b-90038b13a86c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:37.425549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994640-1ca7-4fd2-9d5b-90038b13a86c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:37.425826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994640-1ca7-4fd2-9d5b-90038b13a86c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:37.427139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03994640-1ca7-4fd2-9d5b-90038b13a86c None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=288991c7ac3047c09830fd2e111c1f15, user.id=6bff18dd54594fcc8436b62730738989) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:37.427464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03994640-1ca7-4fd2-9d5b-90038b13a86c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:37.429016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03994640-1ca7-4fd2-9d5b-90038b13a86c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:37.435927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 571/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:45:37 2022] GET /identity/v3/role_assignments?user.id=6bff18dd54594fcc8436b62730738989&scope.project.id=288991c7ac3047c09830fd2e111c1f15&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:39.770275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8591b77-4bc3-4d9f-b13a-c6ebb98febb7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:39.770989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8591b77-4bc3-4d9f-b13a-c6ebb98febb7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:39.770989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8591b77-4bc3-4d9f-b13a-c6ebb98febb7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:39.772418 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 576/1147] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:39.779208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c402c9c-1830-4f65-8a0e-722c02b30247 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:39.779208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c402c9c-1830-4f65-8a0e-722c02b30247 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:39.780345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c402c9c-1830-4f65-8a0e-722c02b30247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:39.798710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0c402c9c-1830-4f65-8a0e-722c02b30247 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:39.800074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0c402c9c-1830-4f65-8a0e-722c02b30247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:39.875439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 572/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:39.901887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8591b77-4bc3-4d9f-b13a-c6ebb98febb7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:39.965481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:40.036768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8591b77-4bc3-4d9f-b13a-c6ebb98febb7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:40.087079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464f0cc-3ed7-405e-a9d1-e3c532226303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:40.088149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464f0cc-3ed7-405e-a9d1-e3c532226303 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:40.088423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464f0cc-3ed7-405e-a9d1-e3c532226303 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:40.088692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464f0cc-3ed7-405e-a9d1-e3c532226303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:40.101530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464f0cc-3ed7-405e-a9d1-e3c532226303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8464f0cc-3ed7-405e-a9d1-e3c532226303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:40.109954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:40.112083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:40.112957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 577/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:45:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:45:40.120131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c402c9c-1830-4f65-8a0e-722c02b30247 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:40.217748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:40.253143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c402c9c-1830-4f65-8a0e-722c02b30247 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:40.293528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58aa87-13a5-420e-895d-df58e95662c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:40.294157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58aa87-13a5-420e-895d-df58e95662c0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:40.294440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58aa87-13a5-420e-895d-df58e95662c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:40.294718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58aa87-13a5-420e-895d-df58e95662c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:40.295499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58aa87-13a5-420e-895d-df58e95662c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:40.295790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58aa87-13a5-420e-895d-df58e95662c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:40.297205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58aa87-13a5-420e-895d-df58e95662c0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:40.307769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 573/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:45:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:40.314282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464f0cc-3ed7-405e-a9d1-e3c532226303 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:40.437603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464f0cc-3ed7-405e-a9d1-e3c532226303 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:40.445602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:40.474965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdcf1b-7667-4270-bec3-068098b59197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:40.475907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdcf1b-7667-4270-bec3-068098b59197 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:40.476193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdcf1b-7667-4270-bec3-068098b59197 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:40.476462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdcf1b-7667-4270-bec3-068098b59197 None admin] PATH_INFO: `/v3/users/6bff18dd54594fcc8436b62730738989` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:40.477777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdcf1b-7667-4270-bec3-068098b59197 None admin] RBAC: Authorizing `identity:get_user(user_id=6bff18dd54594fcc8436b62730738989)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:40.479316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdcf1b-7667-4270-bec3-068098b59197 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:40.481118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 578/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:40 2022] GET /identity/v3/users/6bff18dd54594fcc8436b62730738989 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:40.488027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58aa87-13a5-420e-895d-df58e95662c0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:40.634193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58aa87-13a5-420e-895d-df58e95662c0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:40.681608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366da21-9839-4b4f-9897-b6ba74c3ddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:40.682805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366da21-9839-4b4f-9897-b6ba74c3ddf3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:40.683158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366da21-9839-4b4f-9897-b6ba74c3ddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:40.683507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366da21-9839-4b4f-9897-b6ba74c3ddf3 None admin] PATH_INFO: `/v3/projects/288991c7ac3047c09830fd2e111c1f15` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:40.685170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366da21-9839-4b4f-9897-b6ba74c3ddf3 None admin] RBAC: Authorizing `identity:get_project(project_id=288991c7ac3047c09830fd2e111c1f15)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:40.687229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366da21-9839-4b4f-9897-b6ba74c3ddf3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:40.689602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 574/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:40 2022] GET /identity/v3/projects/288991c7ac3047c09830fd2e111c1f15 => generated 311 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:40.696491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdcf1b-7667-4270-bec3-068098b59197 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:40.810676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdcf1b-7667-4270-bec3-068098b59197 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:40.850234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897238-fc44-489a-aedf-0c394b541228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:40.851266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897238-fc44-489a-aedf-0c394b541228 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:40.851491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897238-fc44-489a-aedf-0c394b541228 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:40.851773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897238-fc44-489a-aedf-0c394b541228 None admin] PATH_INFO: `/v3/projects/288991c7ac3047c09830fd2e111c1f15/users/6bff18dd54594fcc8436b62730738989/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:40.853901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897238-fc44-489a-aedf-0c394b541228 None admin] RBAC: Authorizing `identity:create_grant(project_id=288991c7ac3047c09830fd2e111c1f15, user_id=6bff18dd54594fcc8436b62730738989, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:40.855739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897238-fc44-489a-aedf-0c394b541228 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:40.873071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 579/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:45:40 2022] PUT /identity/v3/projects/288991c7ac3047c09830fd2e111c1f15/users/6bff18dd54594fcc8436b62730738989/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:45:43.036851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46ceed-e0ef-41c6-af1c-592cb5a8d30a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:43.037422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46ceed-e0ef-41c6-af1c-592cb5a8d30a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:43.037422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46ceed-e0ef-41c6-af1c-592cb5a8d30a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:43.038918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 575/1154] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:43.047044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c01b6-17ac-4103-a791-252d9a80ce1f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:43.047565 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c01b6-17ac-4103-a791-252d9a80ce1f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:43.047738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c01b6-17ac-4103-a791-252d9a80ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:43.067825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-909c01b6-17ac-4103-a791-252d9a80ce1f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:43.069271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-909c01b6-17ac-4103-a791-252d9a80ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:43.102333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:43.150721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 580/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:43.175413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46ceed-e0ef-41c6-af1c-592cb5a8d30a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:43.180298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:43.291368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46ceed-e0ef-41c6-af1c-592cb5a8d30a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:43.327616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce545a8-25d7-45d7-ba58-fb7d419b6a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:43.328451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce545a8-25d7-45d7-ba58-fb7d419b6a8f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:43.328732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce545a8-25d7-45d7-ba58-fb7d419b6a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:43.329009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce545a8-25d7-45d7-ba58-fb7d419b6a8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:43.340384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce545a8-25d7-45d7-ba58-fb7d419b6a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5ce545a8-25d7-45d7-ba58-fb7d419b6a8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:43.348767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:43.350014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:43.351361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 576/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:45:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:43.356953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c01b6-17ac-4103-a791-252d9a80ce1f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:43.467448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c01b6-17ac-4103-a791-252d9a80ce1f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:43.503971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aee4cb-4f31-4e45-8c41-e3783a5bf56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:43.504847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aee4cb-4f31-4e45-8c41-e3783a5bf56f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:43.505131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aee4cb-4f31-4e45-8c41-e3783a5bf56f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:43.505416 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aee4cb-4f31-4e45-8c41-e3783a5bf56f None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:43.506202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aee4cb-4f31-4e45-8c41-e3783a5bf56f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:43.506517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aee4cb-4f31-4e45-8c41-e3783a5bf56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:43.507953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aee4cb-4f31-4e45-8c41-e3783a5bf56f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:43.516792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 581/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:43.524607 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce545a8-25d7-45d7-ba58-fb7d419b6a8f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:43.605404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:43.652355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce545a8-25d7-45d7-ba58-fb7d419b6a8f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:43.690865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af140bc5-159d-4161-abb8-223cad164824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:43.691860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140bc5-159d-4161-abb8-223cad164824 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:43.692213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140bc5-159d-4161-abb8-223cad164824 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:43.692479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af140bc5-159d-4161-abb8-223cad164824 None admin] PATH_INFO: `/v3/users/6bff18dd54594fcc8436b62730738989` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:43.693868 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af140bc5-159d-4161-abb8-223cad164824 None admin] RBAC: Authorizing `identity:get_user(user_id=6bff18dd54594fcc8436b62730738989)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:43.695406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af140bc5-159d-4161-abb8-223cad164824 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:43.697197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 577/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:43 2022] GET /identity/v3/users/6bff18dd54594fcc8436b62730738989 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:43.703397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aee4cb-4f31-4e45-8c41-e3783a5bf56f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:43.732868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:43.816721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aee4cb-4f31-4e45-8c41-e3783a5bf56f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:43.853083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e922ae7-5dd9-431c-a0b9-623f85610151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:43.853749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e922ae7-5dd9-431c-a0b9-623f85610151 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:43.854034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e922ae7-5dd9-431c-a0b9-623f85610151 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:43.854330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e922ae7-5dd9-431c-a0b9-623f85610151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:43.930836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e922ae7-5dd9-431c-a0b9-623f85610151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:43.932347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e922ae7-5dd9-431c-a0b9-623f85610151 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:43.962292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:44.048140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 582/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:44.054810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af140bc5-159d-4161-abb8-223cad164824 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:44.174656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af140bc5-159d-4161-abb8-223cad164824 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:44.205776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:44.212323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0871ac2-9b3e-4ef6-8a73-75868ccaf49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:44.213477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0871ac2-9b3e-4ef6-8a73-75868ccaf49b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:44.213980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0871ac2-9b3e-4ef6-8a73-75868ccaf49b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:44.214354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0871ac2-9b3e-4ef6-8a73-75868ccaf49b None admin] PATH_INFO: `/v3/projects/288991c7ac3047c09830fd2e111c1f15` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:44.215919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0871ac2-9b3e-4ef6-8a73-75868ccaf49b None admin] RBAC: Authorizing `identity:get_project(project_id=288991c7ac3047c09830fd2e111c1f15)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:44.218038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0871ac2-9b3e-4ef6-8a73-75868ccaf49b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:44.220392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 578/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:44 2022] GET /identity/v3/projects/288991c7ac3047c09830fd2e111c1f15 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:44.227881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e922ae7-5dd9-431c-a0b9-623f85610151 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:44.347880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e922ae7-5dd9-431c-a0b9-623f85610151 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:44.379473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:44.393290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0dc83-6545-4bc3-b32b-ac8ebcb301be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:44.394045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0dc83-6545-4bc3-b32b-ac8ebcb301be None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:44.394506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0dc83-6545-4bc3-b32b-ac8ebcb301be None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:44.394911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0dc83-6545-4bc3-b32b-ac8ebcb301be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:44.396206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0dc83-6545-4bc3-b32b-ac8ebcb301be None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=288991c7ac3047c09830fd2e111c1f15, user.id=6bff18dd54594fcc8436b62730738989) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:44.396362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0dc83-6545-4bc3-b32b-ac8ebcb301be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:44.398065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0dc83-6545-4bc3-b32b-ac8ebcb301be None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:44.406785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 583/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:45:44 2022] GET /identity/v3/role_assignments?user.id=6bff18dd54594fcc8436b62730738989&scope.project.id=288991c7ac3047c09830fd2e111c1f15&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:46.594715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60106b-a128-4601-9825-6fec3113c4a9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:46.595240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60106b-a128-4601-9825-6fec3113c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:46.595240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60106b-a128-4601-9825-6fec3113c4a9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:46.596828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 579/1162] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:46.607153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf93fb-a137-40ee-b701-eb0836504afc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:46.607969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf93fb-a137-40ee-b701-eb0836504afc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:46.608071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf93fb-a137-40ee-b701-eb0836504afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:46.628935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-80cf93fb-a137-40ee-b701-eb0836504afc None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:46.630286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-80cf93fb-a137-40ee-b701-eb0836504afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:46.713176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 584/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:46.736261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60106b-a128-4601-9825-6fec3113c4a9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:46.853174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60106b-a128-4601-9825-6fec3113c4a9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:46.888772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378cc2e-8869-4f54-a4bd-86f17d1a74c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:46.889440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378cc2e-8869-4f54-a4bd-86f17d1a74c8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:46.889726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378cc2e-8869-4f54-a4bd-86f17d1a74c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:46.890005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378cc2e-8869-4f54-a4bd-86f17d1a74c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:46.956958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:46.959605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378cc2e-8869-4f54-a4bd-86f17d1a74c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:46.961539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378cc2e-8869-4f54-a4bd-86f17d1a74c8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:47.063221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 580/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:47.069890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf93fb-a137-40ee-b701-eb0836504afc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:47.180102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf93fb-a137-40ee-b701-eb0836504afc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:47.200783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:47.215259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27171c85-9cb9-4278-85c8-5f08b7730c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:47.216102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171c85-9cb9-4278-85c8-5f08b7730c92 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:47.216382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171c85-9cb9-4278-85c8-5f08b7730c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:47.216659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27171c85-9cb9-4278-85c8-5f08b7730c92 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:47.224029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27171c85-9cb9-4278-85c8-5f08b7730c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:47.225550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27171c85-9cb9-4278-85c8-5f08b7730c92 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-27171c85-9cb9-4278-85c8-5f08b7730c92 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:47.240840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:47.242209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:45:47.243112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 585/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:45:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:47.249323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378cc2e-8869-4f54-a4bd-86f17d1a74c8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:47.354338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:47.357488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378cc2e-8869-4f54-a4bd-86f17d1a74c8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:47.399584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e34d84-08ae-408b-887b-05a4f3755d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:47.400280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34d84-08ae-408b-887b-05a4f3755d97 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:47.400563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34d84-08ae-408b-887b-05a4f3755d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:47.400848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34d84-08ae-408b-887b-05a4f3755d97 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:47.401577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e34d84-08ae-408b-887b-05a4f3755d97 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:47.401887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e34d84-08ae-408b-887b-05a4f3755d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:47.403365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e34d84-08ae-408b-887b-05a4f3755d97 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:47.411733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 581/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 17 12:45:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:49.558451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3727b3-2ebd-4994-9310-6039f8252662 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:49.559034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3727b3-2ebd-4994-9310-6039f8252662 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:49.559034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3727b3-2ebd-4994-9310-6039f8252662 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:49.560436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 586/1167] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:49.565867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352f51-2d5e-4ed3-95ed-97636be77b50 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:49.566335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352f51-2d5e-4ed3-95ed-97636be77b50 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:49.566451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be352f51-2d5e-4ed3-95ed-97636be77b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:49.584676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-be352f51-2d5e-4ed3-95ed-97636be77b50 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:49.585884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-be352f51-2d5e-4ed3-95ed-97636be77b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:49.669241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 582/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:49.694478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3727b3-2ebd-4994-9310-6039f8252662 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:49.802842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3727b3-2ebd-4994-9310-6039f8252662 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:49.838734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216aaefb-f0b0-45a5-87bf-c587ed99495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:49.839327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216aaefb-f0b0-45a5-87bf-c587ed99495c None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:49.839599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216aaefb-f0b0-45a5-87bf-c587ed99495c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:49.839871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216aaefb-f0b0-45a5-87bf-c587ed99495c None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:49.840610 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216aaefb-f0b0-45a5-87bf-c587ed99495c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:49.842027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216aaefb-f0b0-45a5-87bf-c587ed99495c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:49.867644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 587/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Fri Jun 17 12:45:49 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:45:52.070726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9397a9-e1f8-4d07-a27e-50437b35b0f2 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:52.071454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9397a9-e1f8-4d07-a27e-50437b35b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:52.071618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9397a9-e1f8-4d07-a27e-50437b35b0f2 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:52.073152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 583/1170] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:52.079853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b4d55-8961-43fb-b8aa-b8d88b1447f0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:52.080364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b4d55-8961-43fb-b8aa-b8d88b1447f0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:52.080454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b4d55-8961-43fb-b8aa-b8d88b1447f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:52.098984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1f8b4d55-8961-43fb-b8aa-b8d88b1447f0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:52.100200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1f8b4d55-8961-43fb-b8aa-b8d88b1447f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:52.139341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:52.173731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 588/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:52.204826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9397a9-e1f8-4d07-a27e-50437b35b0f2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:52.317112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:52.325695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9397a9-e1f8-4d07-a27e-50437b35b0f2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:52.362583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe098568-e5e6-4d0f-99bd-07ede0d0af77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:52.363488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098568-e5e6-4d0f-99bd-07ede0d0af77 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:52.363801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098568-e5e6-4d0f-99bd-07ede0d0af77 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:52.364451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe098568-e5e6-4d0f-99bd-07ede0d0af77 None admin] PATH_INFO: `/v3/domains/3c357a77830d491f8e6ab4452bf29631` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:52.376075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe098568-e5e6-4d0f-99bd-07ede0d0af77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c357a77830d491f8e6ab4452bf29631)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:52.377575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe098568-e5e6-4d0f-99bd-07ede0d0af77 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:52.379491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 584/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Fri Jun 17 12:45:52 2022] GET /identity/v3/domains/3c357a77830d491f8e6ab4452bf29631 => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:52.385949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b4d55-8961-43fb-b8aa-b8d88b1447f0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:52.496059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b4d55-8961-43fb-b8aa-b8d88b1447f0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:52.535255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcb7b-80bf-4414-81d5-5f155ed54a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:52.536241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcb7b-80bf-4414-81d5-5f155ed54a37 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:52.536524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcb7b-80bf-4414-81d5-5f155ed54a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:52.536803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcb7b-80bf-4414-81d5-5f155ed54a37 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:52.537501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcb7b-80bf-4414-81d5-5f155ed54a37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:52.539030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcb7b-80bf-4414-81d5-5f155ed54a37 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:52.568847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 589/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:45:52 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:45:54.765557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb076a-250b-4cce-83d2-bc2565dc7e41 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:54.766315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb076a-250b-4cce-83d2-bc2565dc7e41 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:54.766315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb076a-250b-4cce-83d2-bc2565dc7e41 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:54.767568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 585/1174] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:54.773441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b26ce6-1f28-48b8-aad3-3538b38631a1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:54.774474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b26ce6-1f28-48b8-aad3-3538b38631a1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:54.774474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b26ce6-1f28-48b8-aad3-3538b38631a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:54.796013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-00b26ce6-1f28-48b8-aad3-3538b38631a1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:54.797274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-00b26ce6-1f28-48b8-aad3-3538b38631a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:54.824759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:54.913308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 590/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:54.944684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb076a-250b-4cce-83d2-bc2565dc7e41 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:55.058824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb076a-250b-4cce-83d2-bc2565dc7e41 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:55.096916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb214bf5-de6b-4ac7-933b-b33f2700c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:55.097819 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214bf5-de6b-4ac7-933b-b33f2700c761 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:55.098176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214bf5-de6b-4ac7-933b-b33f2700c761 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:55.098460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214bf5-de6b-4ac7-933b-b33f2700c761 None admin] PATH_INFO: `/v3/domains/3c357a77830d491f8e6ab4452bf29631` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:55.099713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb214bf5-de6b-4ac7-933b-b33f2700c761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c357a77830d491f8e6ab4452bf29631)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:55.101222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb214bf5-de6b-4ac7-933b-b33f2700c761 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:55.102973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 586/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Fri Jun 17 12:45:54 2022] GET /identity/v3/domains/3c357a77830d491f8e6ab4452bf29631 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:55.108901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b26ce6-1f28-48b8-aad3-3538b38631a1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:55.215442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b26ce6-1f28-48b8-aad3-3538b38631a1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:55.252239 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb751fa-141b-44f3-9413-e3f0380d3a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:55.252927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb751fa-141b-44f3-9413-e3f0380d3a6a None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:55.253216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb751fa-141b-44f3-9413-e3f0380d3a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:55.253495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb751fa-141b-44f3-9413-e3f0380d3a6a None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:55.254394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb751fa-141b-44f3-9413-e3f0380d3a6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:55.256183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb751fa-141b-44f3-9413-e3f0380d3a6a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:55.279227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 591/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:45:55 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:45:57.547071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb1560-0873-45b2-8719-4b1354ad6f52 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:57.547667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb1560-0873-45b2-8719-4b1354ad6f52 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:57.547667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb1560-0873-45b2-8719-4b1354ad6f52 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:57.549068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 587/1178] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:45:57.554932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b7df3-ea80-40aa-b52e-32728840a50f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:57.555784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b7df3-ea80-40aa-b52e-32728840a50f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:57.555966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b7df3-ea80-40aa-b52e-32728840a50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:57.575095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-758b7df3-ea80-40aa-b52e-32728840a50f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:45:57.576213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-758b7df3-ea80-40aa-b52e-32728840a50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:45:57.578375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:57.685867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 592/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:45:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:45:57.710522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb1560-0873-45b2-8719-4b1354ad6f52 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:57.737679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:57.828873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb1560-0873-45b2-8719-4b1354ad6f52 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:57.871892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1221e-16cd-4f9b-a405-9b44fe81c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:57.872718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1221e-16cd-4f9b-a405-9b44fe81c387 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:57.873010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1221e-16cd-4f9b-a405-9b44fe81c387 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:57.873284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1221e-16cd-4f9b-a405-9b44fe81c387 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:57.888955 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1221e-16cd-4f9b-a405-9b44fe81c387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9dd1221e-16cd-4f9b-a405-9b44fe81c387 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:45:57.906730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:45:57.908349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:45:57.909445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 588/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:45:57.915651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b7df3-ea80-40aa-b52e-32728840a50f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:58.031603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b7df3-ea80-40aa-b52e-32728840a50f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:58.071080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab191e02-e26d-41f1-958c-671bf8ef27b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:58.071764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab191e02-e26d-41f1-958c-671bf8ef27b9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:58.072052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab191e02-e26d-41f1-958c-671bf8ef27b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:58.072327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab191e02-e26d-41f1-958c-671bf8ef27b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:58.073080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab191e02-e26d-41f1-958c-671bf8ef27b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:58.073446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab191e02-e26d-41f1-958c-671bf8ef27b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:58.074845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab191e02-e26d-41f1-958c-671bf8ef27b9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:58.080562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:58.084675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 593/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:58.090973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1221e-16cd-4f9b-a405-9b44fe81c387 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:58.180809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:58.200167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1221e-16cd-4f9b-a405-9b44fe81c387 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:58.236350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa25280-9eed-4a7c-ac31-96651380d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:58.237243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa25280-9eed-4a7c-ac31-96651380d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:58.237519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa25280-9eed-4a7c-ac31-96651380d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:58.237786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa25280-9eed-4a7c-ac31-96651380d6c4 None admin] PATH_INFO: `/v3/users/f2c9a913212e4178abc53c1e6c1eb1a2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:58.253594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa25280-9eed-4a7c-ac31-96651380d6c4 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c9a913212e4178abc53c1e6c1eb1a2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:58.255165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa25280-9eed-4a7c-ac31-96651380d6c4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:58.256930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 589/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:45:58 2022] GET /identity/v3/users/f2c9a913212e4178abc53c1e6c1eb1a2 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:45:58.264124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab191e02-e26d-41f1-958c-671bf8ef27b9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:58.376057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab191e02-e26d-41f1-958c-671bf8ef27b9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:58.435223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70809cb2-0ea5-44b0-ad4d-05054f9d6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:58.436385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70809cb2-0ea5-44b0-ad4d-05054f9d6d78 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:58.436893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70809cb2-0ea5-44b0-ad4d-05054f9d6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:58.437393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70809cb2-0ea5-44b0-ad4d-05054f9d6d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:58.559807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:58.564408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70809cb2-0ea5-44b0-ad4d-05054f9d6d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:58.566357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70809cb2-0ea5-44b0-ad4d-05054f9d6d78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:58.687522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 594/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:45:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:45:58.693991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa25280-9eed-4a7c-ac31-96651380d6c4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:58.799264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa25280-9eed-4a7c-ac31-96651380d6c4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:58.841467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322facec-500e-4566-bdf8-d7c637fcb22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:58.842465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322facec-500e-4566-bdf8-d7c637fcb22d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:58.842776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322facec-500e-4566-bdf8-d7c637fcb22d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:58.843053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322facec-500e-4566-bdf8-d7c637fcb22d None admin] PATH_INFO: `/v3/projects/efffc8b292fa47efa11135e8480484b9` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:58.844651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322facec-500e-4566-bdf8-d7c637fcb22d None admin] RBAC: Authorizing `identity:get_project(project_id=efffc8b292fa47efa11135e8480484b9)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:58.846139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322facec-500e-4566-bdf8-d7c637fcb22d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:58.847968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 590/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:45:58 2022] GET /identity/v3/projects/efffc8b292fa47efa11135e8480484b9 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:45:58.854817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70809cb2-0ea5-44b0-ad4d-05054f9d6d78 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:45:58.959819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:45:58.964254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70809cb2-0ea5-44b0-ad4d-05054f9d6d78 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:45:59.018081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1486-c82f-48bc-972b-711abba5fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:45:59.018783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1486-c82f-48bc-972b-711abba5fcce None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:45:59.019069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1486-c82f-48bc-972b-711abba5fcce None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:45:59.019351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1486-c82f-48bc-972b-711abba5fcce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:45:59.020664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1486-c82f-48bc-972b-711abba5fcce None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=efffc8b292fa47efa11135e8480484b9, user.id=f2c9a913212e4178abc53c1e6c1eb1a2) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:45:59.020976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1486-c82f-48bc-972b-711abba5fcce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:45:59.022496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1486-c82f-48bc-972b-711abba5fcce None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:45:59.028502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 595/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:45:58 2022] GET /identity/v3/role_assignments?user.id=f2c9a913212e4178abc53c1e6c1eb1a2&scope.project.id=efffc8b292fa47efa11135e8480484b9&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:46:01.626571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02850de1-c4e6-4f12-83a3-a7daa4eefb61 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:01.627148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02850de1-c4e6-4f12-83a3-a7daa4eefb61 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:01.627148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02850de1-c4e6-4f12-83a3-a7daa4eefb61 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:01.628617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 591/1186] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:46:01.634761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae92d8-fb4e-4971-9d9e-5fdda2999e04 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:01.635275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae92d8-fb4e-4971-9d9e-5fdda2999e04 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:01.635275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae92d8-fb4e-4971-9d9e-5fdda2999e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:01.653240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-01ae92d8-fb4e-4971-9d9e-5fdda2999e04 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:46:01.654489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-01ae92d8-fb4e-4971-9d9e-5fdda2999e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:46:01.729809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 596/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:46:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:46:01.755204 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02850de1-c4e6-4f12-83a3-a7daa4eefb61 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:01.767157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:01.864515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02850de1-c4e6-4f12-83a3-a7daa4eefb61 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:01.902681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e89b4-27ad-4191-b5bd-06e4a866fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:01.903423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e89b4-27ad-4191-b5bd-06e4a866fc64 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:01.903700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e89b4-27ad-4191-b5bd-06e4a866fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:01.903966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e89b4-27ad-4191-b5bd-06e4a866fc64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:01.915155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e89b4-27ad-4191-b5bd-06e4a866fc64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0e3e89b4-27ad-4191-b5bd-06e4a866fc64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:46:01.923513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:46:01.924663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:46:01.925709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:46:01.930582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 592/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:46:01.931495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae92d8-fb4e-4971-9d9e-5fdda2999e04 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:02.060919 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:02.068996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae92d8-fb4e-4971-9d9e-5fdda2999e04 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:02.105165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831edd-07f2-476d-be97-1ceaa7d56fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:02.105858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831edd-07f2-476d-be97-1ceaa7d56fcf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:02.106171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831edd-07f2-476d-be97-1ceaa7d56fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:02.106450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e831edd-07f2-476d-be97-1ceaa7d56fcf None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:02.107216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e831edd-07f2-476d-be97-1ceaa7d56fcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:46:02.107524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e831edd-07f2-476d-be97-1ceaa7d56fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:46:02.108940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e831edd-07f2-476d-be97-1ceaa7d56fcf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:46:02.118517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 597/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:46:02.124664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e89b4-27ad-4191-b5bd-06e4a866fc64 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:02.201075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:02.242351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e89b4-27ad-4191-b5bd-06e4a866fc64 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:02.278525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65176a-8bb9-4fb5-9804-158d3d5208e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:02.279402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65176a-8bb9-4fb5-9804-158d3d5208e6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:02.279698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65176a-8bb9-4fb5-9804-158d3d5208e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:02.279979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65176a-8bb9-4fb5-9804-158d3d5208e6 None admin] PATH_INFO: `/v3/users/f2c9a913212e4178abc53c1e6c1eb1a2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:02.283862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65176a-8bb9-4fb5-9804-158d3d5208e6 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c9a913212e4178abc53c1e6c1eb1a2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:46:02.285369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65176a-8bb9-4fb5-9804-158d3d5208e6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:46:02.287894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 593/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:46:02 2022] GET /identity/v3/users/f2c9a913212e4178abc53c1e6c1eb1a2 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:46:02.293895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831edd-07f2-476d-be97-1ceaa7d56fcf None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:02.411685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e831edd-07f2-476d-be97-1ceaa7d56fcf None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:02.449757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a12b9-ec73-4285-a478-d16aca893fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:02.450682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a12b9-ec73-4285-a478-d16aca893fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:02.450967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a12b9-ec73-4285-a478-d16aca893fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:02.451300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a12b9-ec73-4285-a478-d16aca893fc1 None admin] PATH_INFO: `/v3/projects/efffc8b292fa47efa11135e8480484b9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:02.452453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a12b9-ec73-4285-a478-d16aca893fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=efffc8b292fa47efa11135e8480484b9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:46:02.453946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a12b9-ec73-4285-a478-d16aca893fc1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:46:02.455724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 598/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:46:02 2022] GET /identity/v3/projects/efffc8b292fa47efa11135e8480484b9 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:46:02.462291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65176a-8bb9-4fb5-9804-158d3d5208e6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:02.578628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65176a-8bb9-4fb5-9804-158d3d5208e6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:02.630002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bacf8a-e8ba-4ef0-bec7-b77cc45b9d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:02.630826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bacf8a-e8ba-4ef0-bec7-b77cc45b9d51 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:02.631104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bacf8a-e8ba-4ef0-bec7-b77cc45b9d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:02.631379 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bacf8a-e8ba-4ef0-bec7-b77cc45b9d51 None admin] PATH_INFO: `/v3/projects/efffc8b292fa47efa11135e8480484b9/users/f2c9a913212e4178abc53c1e6c1eb1a2/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:02.633365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bacf8a-e8ba-4ef0-bec7-b77cc45b9d51 None admin] RBAC: Authorizing `identity:create_grant(project_id=efffc8b292fa47efa11135e8480484b9, user_id=f2c9a913212e4178abc53c1e6c1eb1a2, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:46:02.634967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bacf8a-e8ba-4ef0-bec7-b77cc45b9d51 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:46:02.638245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:02.652972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 594/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:46:02 2022] PUT /identity/v3/projects/efffc8b292fa47efa11135e8480484b9/users/f2c9a913212e4178abc53c1e6c1eb1a2/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:46:04.859235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6be39-f2f7-457f-b8dc-698d60295555 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:04.859877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6be39-f2f7-457f-b8dc-698d60295555 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:04.859877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6be39-f2f7-457f-b8dc-698d60295555 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:04.861337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 599/1193] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:46:04.868404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b5e0c-c8c1-4884-9889-d36da1499caa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:04.868907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b5e0c-c8c1-4884-9889-d36da1499caa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:04.869116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b5e0c-c8c1-4884-9889-d36da1499caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:04.889762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-212b5e0c-c8c1-4884-9889-d36da1499caa None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:46:04.891055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-212b5e0c-c8c1-4884-9889-d36da1499caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:46:04.961996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 595/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:46:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:46:04.986048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6be39-f2f7-457f-b8dc-698d60295555 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:05.015030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:05.109348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6be39-f2f7-457f-b8dc-698d60295555 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:05.173753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0800b-c4f7-4378-9450-e46a33d46d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:05.174920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0800b-c4f7-4378-9450-e46a33d46d42 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:05.175212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0800b-c4f7-4378-9450-e46a33d46d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:05.175490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0800b-c4f7-4378-9450-e46a33d46d42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:05.195991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0800b-c4f7-4378-9450-e46a33d46d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-91a0800b-c4f7-4378-9450-e46a33d46d42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:46:05.205409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:46:05.206668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:46:05.207673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 600/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:46:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:46:05.213329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b5e0c-c8c1-4884-9889-d36da1499caa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:05.321886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b5e0c-c8c1-4884-9889-d36da1499caa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:05.349029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:05.358663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049a34c-4408-436f-aa39-5e404b247b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:05.359407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049a34c-4408-436f-aa39-5e404b247b06 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:05.359629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049a34c-4408-436f-aa39-5e404b247b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:05.359913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049a34c-4408-436f-aa39-5e404b247b06 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:05.360666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049a34c-4408-436f-aa39-5e404b247b06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:46:05.360973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049a34c-4408-436f-aa39-5e404b247b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:46:05.362393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049a34c-4408-436f-aa39-5e404b247b06 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:46:05.371665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 596/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:46:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:46:05.377894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0800b-c4f7-4378-9450-e46a33d46d42 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:05.493495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:05.516088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0800b-c4f7-4378-9450-e46a33d46d42 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:05.563031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924a265-78db-4068-811f-4ceb37673a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:05.564051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924a265-78db-4068-811f-4ceb37673a96 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:05.564339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924a265-78db-4068-811f-4ceb37673a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:05.564617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924a265-78db-4068-811f-4ceb37673a96 None admin] PATH_INFO: `/v3/users/f2c9a913212e4178abc53c1e6c1eb1a2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:05.565858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924a265-78db-4068-811f-4ceb37673a96 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c9a913212e4178abc53c1e6c1eb1a2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:46:05.567827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924a265-78db-4068-811f-4ceb37673a96 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:46:05.569533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 601/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 17 12:46:05 2022] GET /identity/v3/users/f2c9a913212e4178abc53c1e6c1eb1a2 => generated 311 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:46:05.575749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049a34c-4408-436f-aa39-5e404b247b06 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:05.696932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049a34c-4408-436f-aa39-5e404b247b06 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:05.737173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35c5f7-a193-4a1c-9e7b-2c3e74912f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:05.737828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35c5f7-a193-4a1c-9e7b-2c3e74912f57 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:05.738125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35c5f7-a193-4a1c-9e7b-2c3e74912f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:05.738412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35c5f7-a193-4a1c-9e7b-2c3e74912f57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:05.798016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:05.812126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35c5f7-a193-4a1c-9e7b-2c3e74912f57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:46:05.813628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35c5f7-a193-4a1c-9e7b-2c3e74912f57 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:46:05.929211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 597/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:46:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:46:05.938596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924a265-78db-4068-811f-4ceb37673a96 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:06.054651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924a265-78db-4068-811f-4ceb37673a96 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:06.091302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acebd4-591c-43ce-82ba-c5d478658e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:06.092277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acebd4-591c-43ce-82ba-c5d478658e3b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:06.092557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acebd4-591c-43ce-82ba-c5d478658e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:06.092831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acebd4-591c-43ce-82ba-c5d478658e3b None admin] PATH_INFO: `/v3/projects/efffc8b292fa47efa11135e8480484b9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:06.094040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acebd4-591c-43ce-82ba-c5d478658e3b None admin] RBAC: Authorizing `identity:get_project(project_id=efffc8b292fa47efa11135e8480484b9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:46:06.095559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acebd4-591c-43ce-82ba-c5d478658e3b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:46:06.097317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 602/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 17 12:46:05 2022] GET /identity/v3/projects/efffc8b292fa47efa11135e8480484b9 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:46:06.105674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35c5f7-a193-4a1c-9e7b-2c3e74912f57 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:46:06.223691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:06.236368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35c5f7-a193-4a1c-9e7b-2c3e74912f57 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:46:06.272285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8781c-92b5-47e2-b4b8-1c70c00dad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:46:06.272974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8781c-92b5-47e2-b4b8-1c70c00dad6e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:46:06.273252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8781c-92b5-47e2-b4b8-1c70c00dad6e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:46:06.273517 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8781c-92b5-47e2-b4b8-1c70c00dad6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:46:06.274399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8781c-92b5-47e2-b4b8-1c70c00dad6e None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=efffc8b292fa47efa11135e8480484b9, user.id=f2c9a913212e4178abc53c1e6c1eb1a2) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:46:06.274714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8781c-92b5-47e2-b4b8-1c70c00dad6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:46:06.276175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8781c-92b5-47e2-b4b8-1c70c00dad6e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:46:06.282442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 598/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:46:06 2022] GET /identity/v3/role_assignments?user.id=f2c9a913212e4178abc53c1e6c1eb1a2&scope.project.id=efffc8b292fa47efa11135e8480484b9&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:46:16.086553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:46:16.279610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=24 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:04.690220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd970d-2c35-413c-b2ce-53266dd4ec3b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:04.695373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd970d-2c35-413c-b2ce-53266dd4ec3b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:04.695373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd970d-2c35-413c-b2ce-53266dd4ec3b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:04.695373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 603/1201] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:04.700324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2adcdd-5e9f-4b16-afed-8c6218ef6767 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:04.700837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2adcdd-5e9f-4b16-afed-8c6218ef6767 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:04.700934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2adcdd-5e9f-4b16-afed-8c6218ef6767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:04.721722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2f2adcdd-5e9f-4b16-afed-8c6218ef6767 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:04.723015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2f2adcdd-5e9f-4b16-afed-8c6218ef6767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:04.815832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 599/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:47:04.840674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd970d-2c35-413c-b2ce-53266dd4ec3b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:05.012308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd970d-2c35-413c-b2ce-53266dd4ec3b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:05.070411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1473-55af-4cc9-92fc-b779c7afcb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:05.071541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1473-55af-4cc9-92fc-b779c7afcb09 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:05.071979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1473-55af-4cc9-92fc-b779c7afcb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:05.072493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de1473-55af-4cc9-92fc-b779c7afcb09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:05.087062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de1473-55af-4cc9-92fc-b779c7afcb09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:05.089452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de1473-55af-4cc9-92fc-b779c7afcb09 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-55de1473-55af-4cc9-92fc-b779c7afcb09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:05.113259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:05.119192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:05.120270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:05.120270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:05.120270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:05.120270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:05.120270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 604/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:05.122362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2adcdd-5e9f-4b16-afed-8c6218ef6767 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:05.271375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2adcdd-5e9f-4b16-afed-8c6218ef6767 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:05.314134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:05.323783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746f799-f6ac-44ff-9052-ee6d06dcc897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:05.324614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746f799-f6ac-44ff-9052-ee6d06dcc897 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:05.324904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746f799-f6ac-44ff-9052-ee6d06dcc897 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:05.325229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746f799-f6ac-44ff-9052-ee6d06dcc897 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:05.325981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746f799-f6ac-44ff-9052-ee6d06dcc897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:05.326333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746f799-f6ac-44ff-9052-ee6d06dcc897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:05.328333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746f799-f6ac-44ff-9052-ee6d06dcc897 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:05.351508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 600/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:05.357879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1473-55af-4cc9-92fc-b779c7afcb09 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:05.437407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:05.499799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de1473-55af-4cc9-92fc-b779c7afcb09 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:05.541946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ab957-1fad-4d2c-bc72-ac57eb4f0452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:05.542646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ab957-1fad-4d2c-bc72-ac57eb4f0452 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:05.542930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ab957-1fad-4d2c-bc72-ac57eb4f0452 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:05.543210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ab957-1fad-4d2c-bc72-ac57eb4f0452 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:05.543925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ab957-1fad-4d2c-bc72-ac57eb4f0452 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:05.545417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ab957-1fad-4d2c-bc72-ac57eb4f0452 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:05.573316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 605/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 17 12:47:05 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:47:07.883609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38bd07-c9c4-4554-8872-6474bbd74b11 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:07.884211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38bd07-c9c4-4554-8872-6474bbd74b11 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:07.884211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38bd07-c9c4-4554-8872-6474bbd74b11 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:07.885743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 601/1206] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:07.891812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fbfe9-275c-4e38-8d91-9b709aee67e1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:07.892301 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fbfe9-275c-4e38-8d91-9b709aee67e1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:07.892428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fbfe9-275c-4e38-8d91-9b709aee67e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:07.913376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-475fbfe9-275c-4e38-8d91-9b709aee67e1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:07.915149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-475fbfe9-275c-4e38-8d91-9b709aee67e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:08.013749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 606/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:47:08.038530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38bd07-c9c4-4554-8872-6474bbd74b11 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:08.168475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38bd07-c9c4-4554-8872-6474bbd74b11 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:08.210289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94871ec6-7d0d-4d5f-9cf4-c3a2f00c7b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:08.211129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94871ec6-7d0d-4d5f-9cf4-c3a2f00c7b6e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:08.211407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94871ec6-7d0d-4d5f-9cf4-c3a2f00c7b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:08.211677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94871ec6-7d0d-4d5f-9cf4-c3a2f00c7b6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:08.224829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94871ec6-7d0d-4d5f-9cf4-c3a2f00c7b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-94871ec6-7d0d-4d5f-9cf4-c3a2f00c7b6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:47:08.233088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:08.235002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:08.236699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 602/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:47:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:08.241402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fbfe9-275c-4e38-8d91-9b709aee67e1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:08.296799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:08.367442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fbfe9-275c-4e38-8d91-9b709aee67e1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:08.413575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f7c07-4d2c-49ba-a215-7254b9bc7412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:08.414303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7c07-4d2c-49ba-a215-7254b9bc7412 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:08.414583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7c07-4d2c-49ba-a215-7254b9bc7412 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:08.414926 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7c07-4d2c-49ba-a215-7254b9bc7412 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:08.415788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f7c07-4d2c-49ba-a215-7254b9bc7412 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:08.415965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f7c07-4d2c-49ba-a215-7254b9bc7412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:08.417336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f7c07-4d2c-49ba-a215-7254b9bc7412 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:08.433697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94871ec6-7d0d-4d5f-9cf4-c3a2f00c7b6e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:08.434065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 607/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:47:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:08.516762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:08.621564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94871ec6-7d0d-4d5f-9cf4-c3a2f00c7b6e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:08.661936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac94e2-9838-42d6-96f9-2d219cb78390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:08.662873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac94e2-9838-42d6-96f9-2d219cb78390 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:08.663125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac94e2-9838-42d6-96f9-2d219cb78390 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:08.663393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac94e2-9838-42d6-96f9-2d219cb78390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:08.675420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac94e2-9838-42d6-96f9-2d219cb78390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:08.677068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac94e2-9838-42d6-96f9-2d219cb78390 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-baac94e2-9838-42d6-96f9-2d219cb78390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:08.698271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:08.699453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:08.700862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:08.700862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:08.700862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:08.700862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:08.700862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 603/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:08.710268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f7c07-4d2c-49ba-a215-7254b9bc7412 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:08.852810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:08.857437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f7c07-4d2c-49ba-a215-7254b9bc7412 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:08.899442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede8b48-7065-43de-b52a-45df933ba7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:08.900271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede8b48-7065-43de-b52a-45df933ba7fd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:08.900654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede8b48-7065-43de-b52a-45df933ba7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:08.901019 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede8b48-7065-43de-b52a-45df933ba7fd None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:08.901854 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede8b48-7065-43de-b52a-45df933ba7fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:08.902294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede8b48-7065-43de-b52a-45df933ba7fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:08.903853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede8b48-7065-43de-b52a-45df933ba7fd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:08.923511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 608/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:08.924146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac94e2-9838-42d6-96f9-2d219cb78390 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:09.066343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac94e2-9838-42d6-96f9-2d219cb78390 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:09.067391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:09.110901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a8dca-35c6-4984-8c1a-383cf7aef965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:09.111122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a8dca-35c6-4984-8c1a-383cf7aef965 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:09.111381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a8dca-35c6-4984-8c1a-383cf7aef965 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:09.111596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a8dca-35c6-4984-8c1a-383cf7aef965 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:09.120892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a8dca-35c6-4984-8c1a-383cf7aef965 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:09.122580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a8dca-35c6-4984-8c1a-383cf7aef965 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-980a8dca-35c6-4984-8c1a-383cf7aef965 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:47:09.138500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:09.139598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:09.140619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 604/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:47:09.148208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede8b48-7065-43de-b52a-45df933ba7fd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:09.295078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede8b48-7065-43de-b52a-45df933ba7fd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:09.345684 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf5d9e-051a-4019-8135-8bf48270082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:09.346389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf5d9e-051a-4019-8135-8bf48270082b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:09.346637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf5d9e-051a-4019-8135-8bf48270082b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:09.346937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf5d9e-051a-4019-8135-8bf48270082b None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:09.347912 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf5d9e-051a-4019-8135-8bf48270082b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:09.348451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf5d9e-051a-4019-8135-8bf48270082b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:09.349777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf5d9e-051a-4019-8135-8bf48270082b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:09.374914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 609/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 12:47:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:09.381557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a8dca-35c6-4984-8c1a-383cf7aef965 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:09.519995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a8dca-35c6-4984-8c1a-383cf7aef965 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:09.572226 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66804e54-c363-407c-8823-d8d800d9b423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:09.572972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66804e54-c363-407c-8823-d8d800d9b423 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:09.573338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66804e54-c363-407c-8823-d8d800d9b423 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:09.573698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66804e54-c363-407c-8823-d8d800d9b423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:09.625432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:09.677153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66804e54-c363-407c-8823-d8d800d9b423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:09.678840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66804e54-c363-407c-8823-d8d800d9b423 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:09.805503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 605/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:47:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 12:47:09.810825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf5d9e-051a-4019-8135-8bf48270082b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:09.835980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:09.948681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf5d9e-051a-4019-8135-8bf48270082b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:09.994509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50162-7e84-46f6-b38e-1f6a2aa30667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:09.995408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50162-7e84-46f6-b38e-1f6a2aa30667 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:09.995691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50162-7e84-46f6-b38e-1f6a2aa30667 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:09.995985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50162-7e84-46f6-b38e-1f6a2aa30667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:10.008636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c50162-7e84-46f6-b38e-1f6a2aa30667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:10.010220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c50162-7e84-46f6-b38e-1f6a2aa30667 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f6c50162-7e84-46f6-b38e-1f6a2aa30667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:10.031807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:10.032989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:10.034105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:10.034105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:10.034105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:10.034105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:10.036365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 610/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:10.042565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66804e54-c363-407c-8823-d8d800d9b423 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:10.123924 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:10.183359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66804e54-c363-407c-8823-d8d800d9b423 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:10.233488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e2070-b723-44d8-a56a-8792b82bbf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:10.233488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e2070-b723-44d8-a56a-8792b82bbf79 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:10.233785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e2070-b723-44d8-a56a-8792b82bbf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:10.233879 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e2070-b723-44d8-a56a-8792b82bbf79 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:10.234650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e2070-b723-44d8-a56a-8792b82bbf79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:10.235012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e2070-b723-44d8-a56a-8792b82bbf79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:10.236503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e2070-b723-44d8-a56a-8792b82bbf79 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:10.253017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 606/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:10.263559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50162-7e84-46f6-b38e-1f6a2aa30667 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:10.363864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:10.423153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50162-7e84-46f6-b38e-1f6a2aa30667 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:10.469746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c11b1-82bb-459f-978f-05db20fce12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:10.471009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c11b1-82bb-459f-978f-05db20fce12a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:10.471009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c11b1-82bb-459f-978f-05db20fce12a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:10.471294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c11b1-82bb-459f-978f-05db20fce12a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:10.480743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c11b1-82bb-459f-978f-05db20fce12a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:10.482513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c11b1-82bb-459f-978f-05db20fce12a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-504c11b1-82bb-459f-978f-05db20fce12a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:47:10.499397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:10.500620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:10.501697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:47:10.501697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:47:10.501697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:47:10.501697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:47:10.501697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:47:10.501697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:47:10.501697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:10.501697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:10.506142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 611/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:47:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:10.507386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e2070-b723-44d8-a56a-8792b82bbf79 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:10.659653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e2070-b723-44d8-a56a-8792b82bbf79 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:10.687280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:10.706532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602893f-74ac-440e-b476-cd3dff1d18e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:10.707368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602893f-74ac-440e-b476-cd3dff1d18e4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:10.707709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602893f-74ac-440e-b476-cd3dff1d18e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:10.707709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602893f-74ac-440e-b476-cd3dff1d18e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:10.708937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602893f-74ac-440e-b476-cd3dff1d18e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:10.709512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602893f-74ac-440e-b476-cd3dff1d18e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:10.711359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602893f-74ac-440e-b476-cd3dff1d18e4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:10.728065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 607/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:10.734432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c11b1-82bb-459f-978f-05db20fce12a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:10.871327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c11b1-82bb-459f-978f-05db20fce12a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:10.910708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:10.916412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58a7bd-51b6-4a95-a70b-51d922abede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:10.917242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a7bd-51b6-4a95-a70b-51d922abede1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:10.917534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a7bd-51b6-4a95-a70b-51d922abede1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:10.917747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a7bd-51b6-4a95-a70b-51d922abede1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:10.918613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58a7bd-51b6-4a95-a70b-51d922abede1 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=5d9781351e60447dbcbe4ee51322a3bc) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:10.919440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58a7bd-51b6-4a95-a70b-51d922abede1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:10.920817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58a7bd-51b6-4a95-a70b-51d922abede1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:10.938116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 612/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:47:10 2022] GET /identity/v3/role_assignments?user.id=5d9781351e60447dbcbe4ee51322a3bc&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:13.069418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e28b68-952a-4a7f-8daa-38f007c35eb5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:13.069994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e28b68-952a-4a7f-8daa-38f007c35eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:13.069994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e28b68-952a-4a7f-8daa-38f007c35eb5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:13.071551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 608/1220] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:13.078605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6887479-463e-4915-b09a-45c985eca8b3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:13.079380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6887479-463e-4915-b09a-45c985eca8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:13.079553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6887479-463e-4915-b09a-45c985eca8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:13.101235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d6887479-463e-4915-b09a-45c985eca8b3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:13.102617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d6887479-463e-4915-b09a-45c985eca8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:13.188035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 613/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:47:13.211427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e28b68-952a-4a7f-8daa-38f007c35eb5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:13.330637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e28b68-952a-4a7f-8daa-38f007c35eb5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:13.366758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1713f7e-29e8-4b55-8f5a-b62ba177316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:13.367680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1713f7e-29e8-4b55-8f5a-b62ba177316c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:13.367995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1713f7e-29e8-4b55-8f5a-b62ba177316c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:13.368269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1713f7e-29e8-4b55-8f5a-b62ba177316c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:13.381201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1713f7e-29e8-4b55-8f5a-b62ba177316c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f1713f7e-29e8-4b55-8f5a-b62ba177316c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:47:13.389875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:13.391111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:47:13.392275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:13.396772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 609/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:47:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:13.397850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6887479-463e-4915-b09a-45c985eca8b3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:13.525960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6887479-463e-4915-b09a-45c985eca8b3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:13.556512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:13.567270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138b603-3d38-42e8-bfe5-e1f14511db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:13.568061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138b603-3d38-42e8-bfe5-e1f14511db24 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:13.568249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138b603-3d38-42e8-bfe5-e1f14511db24 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:13.568517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138b603-3d38-42e8-bfe5-e1f14511db24 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:13.569278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138b603-3d38-42e8-bfe5-e1f14511db24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:13.569584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138b603-3d38-42e8-bfe5-e1f14511db24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:13.571324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138b603-3d38-42e8-bfe5-e1f14511db24 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:13.581078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 614/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:47:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:47:13.587324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1713f7e-29e8-4b55-8f5a-b62ba177316c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:13.639870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:13.709497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1713f7e-29e8-4b55-8f5a-b62ba177316c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:13.750135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68684c6b-caca-4a3b-9eaf-46156822406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:13.751055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68684c6b-caca-4a3b-9eaf-46156822406f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:13.751251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68684c6b-caca-4a3b-9eaf-46156822406f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:13.751530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68684c6b-caca-4a3b-9eaf-46156822406f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:13.763835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68684c6b-caca-4a3b-9eaf-46156822406f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:13.765354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68684c6b-caca-4a3b-9eaf-46156822406f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-68684c6b-caca-4a3b-9eaf-46156822406f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:13.789501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:13.797085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:13.798724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:13.798724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:13.798724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:13.798724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:13.798724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 610/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:13.799608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138b603-3d38-42e8-bfe5-e1f14511db24 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:13.922512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138b603-3d38-42e8-bfe5-e1f14511db24 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:13.968401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ed10-96af-416d-97ca-afb77226896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:13.969093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ed10-96af-416d-97ca-afb77226896f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:13.969368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ed10-96af-416d-97ca-afb77226896f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:13.969647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ed10-96af-416d-97ca-afb77226896f None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:13.970422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ed10-96af-416d-97ca-afb77226896f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:13.970727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ed10-96af-416d-97ca-afb77226896f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:13.972184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ed10-96af-416d-97ca-afb77226896f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:13.985287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 615/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:13.991920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68684c6b-caca-4a3b-9eaf-46156822406f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:14.102282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:14.110515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68684c6b-caca-4a3b-9eaf-46156822406f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:14.149214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d86213-8022-49b9-be6b-53a6acf0be33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:14.150058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d86213-8022-49b9-be6b-53a6acf0be33 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:14.150385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d86213-8022-49b9-be6b-53a6acf0be33 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:14.150661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d86213-8022-49b9-be6b-53a6acf0be33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:14.159494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d86213-8022-49b9-be6b-53a6acf0be33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:14.161520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d86213-8022-49b9-be6b-53a6acf0be33 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f9d86213-8022-49b9-be6b-53a6acf0be33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:47:14.180258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:14.181641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:14.183018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 611/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:47:14.187584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ed10-96af-416d-97ca-afb77226896f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:14.243882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:14.310425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ed10-96af-416d-97ca-afb77226896f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:14.354494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b7dae-d59e-4cad-b5f4-14c678e1de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:14.355198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7dae-d59e-4cad-b5f4-14c678e1de6b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:14.355479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7dae-d59e-4cad-b5f4-14c678e1de6b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:14.355754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7dae-d59e-4cad-b5f4-14c678e1de6b None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:14.356878 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b7dae-d59e-4cad-b5f4-14c678e1de6b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:14.357225 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b7dae-d59e-4cad-b5f4-14c678e1de6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:14.359259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b7dae-d59e-4cad-b5f4-14c678e1de6b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:14.378915 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 616/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 12:47:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:14.388032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d86213-8022-49b9-be6b-53a6acf0be33 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:14.503640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d86213-8022-49b9-be6b-53a6acf0be33 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:14.541733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdbdab-d7f9-4812-90a7-1d8070df2da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:14.542671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdbdab-d7f9-4812-90a7-1d8070df2da9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:14.543036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdbdab-d7f9-4812-90a7-1d8070df2da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:14.543227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdbdab-d7f9-4812-90a7-1d8070df2da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:14.555906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdbdab-d7f9-4812-90a7-1d8070df2da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:14.557434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdbdab-d7f9-4812-90a7-1d8070df2da9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-25cdbdab-d7f9-4812-90a7-1d8070df2da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:14.577230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:14.578457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:14.579731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:14.579731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:14.579731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:14.579731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:14.582733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 612/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:14.584775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b7dae-d59e-4cad-b5f4-14c678e1de6b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:14.698428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b7dae-d59e-4cad-b5f4-14c678e1de6b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:14.701429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:14.741401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0961b93-69cc-4bf8-902a-ede00612f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:14.742216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0961b93-69cc-4bf8-902a-ede00612f087 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:14.742503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0961b93-69cc-4bf8-902a-ede00612f087 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:14.742781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0961b93-69cc-4bf8-902a-ede00612f087 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:14.743513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0961b93-69cc-4bf8-902a-ede00612f087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:14.743820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0961b93-69cc-4bf8-902a-ede00612f087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:14.745423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0961b93-69cc-4bf8-902a-ede00612f087 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:14.758654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 617/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:14.764227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdbdab-d7f9-4812-90a7-1d8070df2da9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:14.775271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:14.897341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdbdab-d7f9-4812-90a7-1d8070df2da9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:14.954925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937fbbf-db65-497b-8ce9-6bca251dbd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:14.955809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937fbbf-db65-497b-8ce9-6bca251dbd63 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:14.956121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937fbbf-db65-497b-8ce9-6bca251dbd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:14.956428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937fbbf-db65-497b-8ce9-6bca251dbd63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:14.970462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937fbbf-db65-497b-8ce9-6bca251dbd63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:14.973348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937fbbf-db65-497b-8ce9-6bca251dbd63 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b937fbbf-db65-497b-8ce9-6bca251dbd63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:47:15.002808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:15.004095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:15.005023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:47:15.005023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:47:15.005023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:47:15.005023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:47:15.005023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:47:15.005023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:47:15.005023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:15.005023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:15.005463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 613/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:47:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:15.012376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0961b93-69cc-4bf8-902a-ede00612f087 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:15.157767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0961b93-69cc-4bf8-902a-ede00612f087 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:15.210385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535496e2-2dd2-4555-b2e2-28c8881ab544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:15.211101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535496e2-2dd2-4555-b2e2-28c8881ab544 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:15.211353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535496e2-2dd2-4555-b2e2-28c8881ab544 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:15.211635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535496e2-2dd2-4555-b2e2-28c8881ab544 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:15.212665 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535496e2-2dd2-4555-b2e2-28c8881ab544 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:15.212962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535496e2-2dd2-4555-b2e2-28c8881ab544 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:15.214842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535496e2-2dd2-4555-b2e2-28c8881ab544 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:15.228509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 618/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:47:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:47:15.234903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937fbbf-db65-497b-8ce9-6bca251dbd63 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:15.312797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:15.351865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937fbbf-db65-497b-8ce9-6bca251dbd63 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:15.396150 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270e7bd-46e3-4b79-ab82-024d4e57328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:15.397528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270e7bd-46e3-4b79-ab82-024d4e57328f None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:15.397867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270e7bd-46e3-4b79-ab82-024d4e57328f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:15.398273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270e7bd-46e3-4b79-ab82-024d4e57328f None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/5d9781351e60447dbcbe4ee51322a3bc/roles/b90ffd0563104828953ba36cc5447825` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:15.422050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270e7bd-46e3-4b79-ab82-024d4e57328f None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=5d9781351e60447dbcbe4ee51322a3bc, role_id=b90ffd0563104828953ba36cc5447825)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:15.423796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270e7bd-46e3-4b79-ab82-024d4e57328f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:15.440339 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 614/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:47:15 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/5d9781351e60447dbcbe4ee51322a3bc/roles/b90ffd0563104828953ba36cc5447825 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:47:17.708794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9aba-1b3d-43f2-ac77-1aa946d74099 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:17.709437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9aba-1b3d-43f2-ac77-1aa946d74099 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:17.709437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9aba-1b3d-43f2-ac77-1aa946d74099 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:17.710750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 619/1233] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:17.718612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d474cce-56f1-4dcd-9bb7-420624c9878b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:17.719153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d474cce-56f1-4dcd-9bb7-420624c9878b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:17.719153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d474cce-56f1-4dcd-9bb7-420624c9878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:17.747418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3d474cce-56f1-4dcd-9bb7-420624c9878b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:17.749040 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3d474cce-56f1-4dcd-9bb7-420624c9878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:17.842834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 615/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:47:17.867602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9aba-1b3d-43f2-ac77-1aa946d74099 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:17.901962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:17.998745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9aba-1b3d-43f2-ac77-1aa946d74099 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:18.041598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76664e7a-bc53-49d8-8d64-02ec263dd8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:18.042448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76664e7a-bc53-49d8-8d64-02ec263dd8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:18.042756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76664e7a-bc53-49d8-8d64-02ec263dd8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:18.043002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76664e7a-bc53-49d8-8d64-02ec263dd8a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:18.056689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76664e7a-bc53-49d8-8d64-02ec263dd8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-76664e7a-bc53-49d8-8d64-02ec263dd8a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:47:18.066313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:18.068397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:18.069468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 620/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 17 12:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:18.074419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d474cce-56f1-4dcd-9bb7-420624c9878b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:18.126112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:18.185763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d474cce-56f1-4dcd-9bb7-420624c9878b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:18.230937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6fb98-6be0-4e49-bd87-3ef5d8e6d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:18.231638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6fb98-6be0-4e49-bd87-3ef5d8e6d6ce None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:18.231917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6fb98-6be0-4e49-bd87-3ef5d8e6d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:18.232209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6fb98-6be0-4e49-bd87-3ef5d8e6d6ce None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:18.232950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6fb98-6be0-4e49-bd87-3ef5d8e6d6ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:18.233257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6fb98-6be0-4e49-bd87-3ef5d8e6d6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:18.234932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6fb98-6be0-4e49-bd87-3ef5d8e6d6ce None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:18.246565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 616/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 17 12:47:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:47:18.252740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76664e7a-bc53-49d8-8d64-02ec263dd8a5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:18.351732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:18.370373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76664e7a-bc53-49d8-8d64-02ec263dd8a5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:18.415785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6738a-62c6-4e86-a61f-4076e7bf17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:18.416746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6738a-62c6-4e86-a61f-4076e7bf17f3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:18.417143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6738a-62c6-4e86-a61f-4076e7bf17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:18.417632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6738a-62c6-4e86-a61f-4076e7bf17f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:18.432183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6738a-62c6-4e86-a61f-4076e7bf17f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:18.434487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6738a-62c6-4e86-a61f-4076e7bf17f3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9eb6738a-62c6-4e86-a61f-4076e7bf17f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:18.457970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:18.464004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:18.465146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:18.465146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:18.465146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:18.465146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:18.465146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 621/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:18.465625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6fb98-6be0-4e49-bd87-3ef5d8e6d6ce None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:18.632387 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6fb98-6be0-4e49-bd87-3ef5d8e6d6ce None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:18.643042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:18.672597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b760d6-81de-4414-b660-fd1022ba8aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:18.673283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b760d6-81de-4414-b660-fd1022ba8aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:18.673561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b760d6-81de-4414-b660-fd1022ba8aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:18.673834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b760d6-81de-4414-b660-fd1022ba8aa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:18.674597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b760d6-81de-4414-b660-fd1022ba8aa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:18.674900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b760d6-81de-4414-b660-fd1022ba8aa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:18.676497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b760d6-81de-4414-b660-fd1022ba8aa2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:18.690648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 617/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:18.697217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6738a-62c6-4e86-a61f-4076e7bf17f3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:18.812730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6738a-62c6-4e86-a61f-4076e7bf17f3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:18.851530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d996768-b973-48a4-9659-8c26d60b8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:18.852378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d996768-b973-48a4-9659-8c26d60b8482 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:18.852695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d996768-b973-48a4-9659-8c26d60b8482 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:18.852978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d996768-b973-48a4-9659-8c26d60b8482 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:18.856235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:18.862698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d996768-b973-48a4-9659-8c26d60b8482 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:18.864909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d996768-b973-48a4-9659-8c26d60b8482 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7d996768-b973-48a4-9659-8c26d60b8482 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:47:18.882278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:18.883557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:18.884533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 622/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:18.889813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b760d6-81de-4414-b660-fd1022ba8aa2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:19.009733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b760d6-81de-4414-b660-fd1022ba8aa2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:19.049323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a10e9-c9b4-4a3a-b963-51729736a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:19.050200 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a10e9-c9b4-4a3a-b963-51729736a515 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:19.050542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a10e9-c9b4-4a3a-b963-51729736a515 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:19.050867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a10e9-c9b4-4a3a-b963-51729736a515 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:19.051813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a10e9-c9b4-4a3a-b963-51729736a515 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:19.052126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a10e9-c9b4-4a3a-b963-51729736a515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:19.053641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a10e9-c9b4-4a3a-b963-51729736a515 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:19.072843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 618/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 12:47:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:19.078940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d996768-b973-48a4-9659-8c26d60b8482 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:19.192853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d996768-b973-48a4-9659-8c26d60b8482 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:19.233397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c98e9-64f1-4978-b0d8-5066b7d9969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:19.234245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c98e9-64f1-4978-b0d8-5066b7d9969b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:19.234613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c98e9-64f1-4978-b0d8-5066b7d9969b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:19.234872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c98e9-64f1-4978-b0d8-5066b7d9969b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:19.305270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:19.316620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c98e9-64f1-4978-b0d8-5066b7d9969b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:19.318432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c98e9-64f1-4978-b0d8-5066b7d9969b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:19.450022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 623/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:47:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:47:19.456775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a10e9-c9b4-4a3a-b963-51729736a515 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:19.491002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:19.588036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a10e9-c9b4-4a3a-b963-51729736a515 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:19.630293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650fc29-da43-4f51-ab3f-0299753b504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:19.631466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650fc29-da43-4f51-ab3f-0299753b504c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:19.631466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650fc29-da43-4f51-ab3f-0299753b504c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:19.631688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650fc29-da43-4f51-ab3f-0299753b504c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:19.643910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650fc29-da43-4f51-ab3f-0299753b504c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:19.645898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650fc29-da43-4f51-ab3f-0299753b504c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3650fc29-da43-4f51-ab3f-0299753b504c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:19.666451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:19.667639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:19.668992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:19.668992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:19.668992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:19.668992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:19.668992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 619/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:19.673746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c98e9-64f1-4978-b0d8-5066b7d9969b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:19.780051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:19.786041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c98e9-64f1-4978-b0d8-5066b7d9969b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:19.822417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba08b34-d08c-4635-85cd-6b6ad489e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:19.823143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba08b34-d08c-4635-85cd-6b6ad489e71e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:19.823398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba08b34-d08c-4635-85cd-6b6ad489e71e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:19.823602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba08b34-d08c-4635-85cd-6b6ad489e71e None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:19.824328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba08b34-d08c-4635-85cd-6b6ad489e71e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:19.824656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba08b34-d08c-4635-85cd-6b6ad489e71e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:19.826072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba08b34-d08c-4635-85cd-6b6ad489e71e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:19.838666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 624/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:19.844898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650fc29-da43-4f51-ab3f-0299753b504c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:19.963365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:19.994110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650fc29-da43-4f51-ab3f-0299753b504c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:20.035098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93353c49-4829-411b-8967-026f74e66227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:20.035837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93353c49-4829-411b-8967-026f74e66227 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:20.036127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93353c49-4829-411b-8967-026f74e66227 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:20.036410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93353c49-4829-411b-8967-026f74e66227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:20.044186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93353c49-4829-411b-8967-026f74e66227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:20.046095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93353c49-4829-411b-8967-026f74e66227 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-93353c49-4829-411b-8967-026f74e66227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:47:20.062898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:20.064063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:20.070251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:47:20.070251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:47:20.070251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:47:20.070251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:47:20.070251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:47:20.070251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:47:20.070251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:20.070251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:20.070251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 620/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:20.070856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba08b34-d08c-4635-85cd-6b6ad489e71e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:20.197727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba08b34-d08c-4635-85cd-6b6ad489e71e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:20.243393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0f30-7ee5-4931-8bb0-0e56a9cc18cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:20.244109 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0f30-7ee5-4931-8bb0-0e56a9cc18cd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:20.244400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0f30-7ee5-4931-8bb0-0e56a9cc18cd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:20.244658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0f30-7ee5-4931-8bb0-0e56a9cc18cd None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:20.245478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0f30-7ee5-4931-8bb0-0e56a9cc18cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:20.245793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0f30-7ee5-4931-8bb0-0e56a9cc18cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:20.247431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0f30-7ee5-4931-8bb0-0e56a9cc18cd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:20.268565 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 625/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:20.270113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93353c49-4829-411b-8967-026f74e66227 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:20.405402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93353c49-4829-411b-8967-026f74e66227 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:20.457942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4d665-ffc4-4217-a9c2-c7be8edd83c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:20.458671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4d665-ffc4-4217-a9c2-c7be8edd83c4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:20.459017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4d665-ffc4-4217-a9c2-c7be8edd83c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:20.459294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4d665-ffc4-4217-a9c2-c7be8edd83c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:20.460209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4d665-ffc4-4217-a9c2-c7be8edd83c4 None admin] RBAC: Adding query filter params (role.id=b90ffd0563104828953ba36cc5447825, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=5d9781351e60447dbcbe4ee51322a3bc) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:20.460524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4d665-ffc4-4217-a9c2-c7be8edd83c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:20.462041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4d665-ffc4-4217-a9c2-c7be8edd83c4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:20.470156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 621/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:47:20 2022] GET /identity/v3/role_assignments?user.id=5d9781351e60447dbcbe4ee51322a3bc&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=b90ffd0563104828953ba36cc5447825 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:22.729813 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314151-8b50-4ee7-8165-11625413a7a8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:22.730750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314151-8b50-4ee7-8165-11625413a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:22.730750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314151-8b50-4ee7-8165-11625413a7a8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:22.731754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 626/1247] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:22.738636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2849edb-e82c-410b-90e6-04b192884cde None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:22.739240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2849edb-e82c-410b-90e6-04b192884cde None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:22.739333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2849edb-e82c-410b-90e6-04b192884cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:22.747654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:22.761821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c2849edb-e82c-410b-90e6-04b192884cde None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:22.763220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2849edb-e82c-410b-90e6-04b192884cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:22.847785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 622/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:47:22.872179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f314151-8b50-4ee7-8165-11625413a7a8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:22.899227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:23.013711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f314151-8b50-4ee7-8165-11625413a7a8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:23.051775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432e14-39ed-464e-b9dd-8667276a4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:23.052681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432e14-39ed-464e-b9dd-8667276a4399 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:23.052993 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432e14-39ed-464e-b9dd-8667276a4399 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:23.053297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432e14-39ed-464e-b9dd-8667276a4399 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:23.065226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d432e14-39ed-464e-b9dd-8667276a4399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9d432e14-39ed-464e-b9dd-8667276a4399 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:47:23.074499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:23.075742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:23.076596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 627/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:23.083284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2849edb-e82c-410b-90e6-04b192884cde None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:23.209946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2849edb-e82c-410b-90e6-04b192884cde None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:23.251656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:23.258735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d86b8d-0734-4e7b-b090-bd95d7bba530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:23.259569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d86b8d-0734-4e7b-b090-bd95d7bba530 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:23.260085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d86b8d-0734-4e7b-b090-bd95d7bba530 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:23.260456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d86b8d-0734-4e7b-b090-bd95d7bba530 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:23.261654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d86b8d-0734-4e7b-b090-bd95d7bba530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:23.262070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d86b8d-0734-4e7b-b090-bd95d7bba530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:23.264199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d86b8d-0734-4e7b-b090-bd95d7bba530 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:23.276946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 623/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:23.283884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432e14-39ed-464e-b9dd-8667276a4399 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:23.380132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:23.408652 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432e14-39ed-464e-b9dd-8667276a4399 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:23.451949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0896da-d79c-4804-999b-b605a48d3dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:23.452946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0896da-d79c-4804-999b-b605a48d3dba None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:23.453218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0896da-d79c-4804-999b-b605a48d3dba None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:23.453558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0896da-d79c-4804-999b-b605a48d3dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:23.466876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0896da-d79c-4804-999b-b605a48d3dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:23.468520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0896da-d79c-4804-999b-b605a48d3dba None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8c0896da-d79c-4804-999b-b605a48d3dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:23.490954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:23.492238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:23.493175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:23.493175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:23.493175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:23.493175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:23.493175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 628/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:23.498853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d86b8d-0734-4e7b-b090-bd95d7bba530 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:23.642099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d86b8d-0734-4e7b-b090-bd95d7bba530 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:23.683973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa7996-6ee8-4d46-83ce-394e24b42e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:23.684663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa7996-6ee8-4d46-83ce-394e24b42e32 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:23.684947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa7996-6ee8-4d46-83ce-394e24b42e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:23.685219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa7996-6ee8-4d46-83ce-394e24b42e32 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:23.685948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa7996-6ee8-4d46-83ce-394e24b42e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:23.686289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa7996-6ee8-4d46-83ce-394e24b42e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:23.687684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa7996-6ee8-4d46-83ce-394e24b42e32 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:23.701318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 624/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:23.708574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0896da-d79c-4804-999b-b605a48d3dba None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:23.845365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0896da-d79c-4804-999b-b605a48d3dba None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:23.880591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:23.891644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bd5e2-8015-46fc-b190-d51b52be572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:23.892580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd5e2-8015-46fc-b190-d51b52be572c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:23.892809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd5e2-8015-46fc-b190-d51b52be572c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:23.893082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd5e2-8015-46fc-b190-d51b52be572c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:23.901705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bd5e2-8015-46fc-b190-d51b52be572c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:23.903394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bd5e2-8015-46fc-b190-d51b52be572c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-631bd5e2-8015-46fc-b190-d51b52be572c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:47:23.920593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:23.922269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:23.923809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 629/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:23.929633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa7996-6ee8-4d46-83ce-394e24b42e32 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:24.015329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:24.075693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa7996-6ee8-4d46-83ce-394e24b42e32 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:24.119417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729cf43-2f63-43af-a621-427efc8d56ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:24.120140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729cf43-2f63-43af-a621-427efc8d56ab None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:24.120406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729cf43-2f63-43af-a621-427efc8d56ab None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:24.120689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729cf43-2f63-43af-a621-427efc8d56ab None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:24.121571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729cf43-2f63-43af-a621-427efc8d56ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:24.121882 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729cf43-2f63-43af-a621-427efc8d56ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:24.123455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729cf43-2f63-43af-a621-427efc8d56ab None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:24.142500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 625/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 12:47:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:24.150315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bd5e2-8015-46fc-b190-d51b52be572c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:24.275091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bd5e2-8015-46fc-b190-d51b52be572c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:24.318025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961b6b-9d64-4550-9512-768687695920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:24.318754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961b6b-9d64-4550-9512-768687695920 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:24.319011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961b6b-9d64-4550-9512-768687695920 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:24.319287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961b6b-9d64-4550-9512-768687695920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:24.390632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:24.407175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53961b6b-9d64-4550-9512-768687695920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:24.408623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53961b6b-9d64-4550-9512-768687695920 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:24.536140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 630/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:47:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 12:47:24.542014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729cf43-2f63-43af-a621-427efc8d56ab None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:24.660708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729cf43-2f63-43af-a621-427efc8d56ab None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:24.676303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:24.702435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e85c2-9167-43d4-9cb3-23c8e703df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:24.703344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e85c2-9167-43d4-9cb3-23c8e703df30 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:24.703627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e85c2-9167-43d4-9cb3-23c8e703df30 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:24.703882 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e85c2-9167-43d4-9cb3-23c8e703df30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:24.723396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e85c2-9167-43d4-9cb3-23c8e703df30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:24.724936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e85c2-9167-43d4-9cb3-23c8e703df30 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-fc0e85c2-9167-43d4-9cb3-23c8e703df30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:24.749681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:24.750812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:24.751709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:24.751709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:24.751709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:24.751709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:24.751929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 626/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:24.758356 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961b6b-9d64-4550-9512-768687695920 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:24.853245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:24.869476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961b6b-9d64-4550-9512-768687695920 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:24.916967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49361-a1d5-4baf-b2b1-cd9180156d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:24.917760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49361-a1d5-4baf-b2b1-cd9180156d3a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:24.918178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49361-a1d5-4baf-b2b1-cd9180156d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:24.918529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49361-a1d5-4baf-b2b1-cd9180156d3a None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:24.919350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a49361-a1d5-4baf-b2b1-cd9180156d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:24.919727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a49361-a1d5-4baf-b2b1-cd9180156d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:24.921374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a49361-a1d5-4baf-b2b1-cd9180156d3a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:24.943102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 631/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:24.944448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e85c2-9167-43d4-9cb3-23c8e703df30 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:25.080607 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e85c2-9167-43d4-9cb3-23c8e703df30 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:25.122353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535e96d-29c8-4a59-94ce-1dcc1c31e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:25.123181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535e96d-29c8-4a59-94ce-1dcc1c31e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:25.123465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535e96d-29c8-4a59-94ce-1dcc1c31e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:25.123779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535e96d-29c8-4a59-94ce-1dcc1c31e9ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:25.131548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535e96d-29c8-4a59-94ce-1dcc1c31e9ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:25.133005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535e96d-29c8-4a59-94ce-1dcc1c31e9ca None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2535e96d-29c8-4a59-94ce-1dcc1c31e9ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:47:25.148605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:25.155196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:25.156370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:47:25.156370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:47:25.156370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:47:25.156370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:47:25.156370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:47:25.156370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:47:25.156370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:25.156370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:25.156370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 627/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:25.156978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49361-a1d5-4baf-b2b1-cd9180156d3a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:25.301872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49361-a1d5-4baf-b2b1-cd9180156d3a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:25.351463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922582e-11bd-4975-af9b-adb840ffa39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:25.352537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922582e-11bd-4975-af9b-adb840ffa39c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:25.352885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922582e-11bd-4975-af9b-adb840ffa39c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:25.353230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922582e-11bd-4975-af9b-adb840ffa39c None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:25.354496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922582e-11bd-4975-af9b-adb840ffa39c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:25.354800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922582e-11bd-4975-af9b-adb840ffa39c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:25.356369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922582e-11bd-4975-af9b-adb840ffa39c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:25.382003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 632/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:25.383750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535e96d-29c8-4a59-94ce-1dcc1c31e9ca None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:25.423994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:25.531098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535e96d-29c8-4a59-94ce-1dcc1c31e9ca None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:25.574686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08adf4-b66a-4702-b37f-ccd15c2c7fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:25.575297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08adf4-b66a-4702-b37f-ccd15c2c7fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:25.575589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08adf4-b66a-4702-b37f-ccd15c2c7fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:25.575867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08adf4-b66a-4702-b37f-ccd15c2c7fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:25.576773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08adf4-b66a-4702-b37f-ccd15c2c7fa5 None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=5d9781351e60447dbcbe4ee51322a3bc) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:25.577100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08adf4-b66a-4702-b37f-ccd15c2c7fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:25.578744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08adf4-b66a-4702-b37f-ccd15c2c7fa5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:25.586652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 628/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:47:25 2022] GET /identity/v3/role_assignments?user.id=5d9781351e60447dbcbe4ee51322a3bc&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:27.876543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e8a6-ecdd-464a-8eca-2ed630808be2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:27.877156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e8a6-ecdd-464a-8eca-2ed630808be2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:27.877156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9e8a6-ecdd-464a-8eca-2ed630808be2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:27.878703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 633/1261] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:27.884847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcb50f-a7bb-4102-9a52-c08b854d7d0e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:27.885382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcb50f-a7bb-4102-9a52-c08b854d7d0e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:27.885382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcb50f-a7bb-4102-9a52-c08b854d7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:27.903685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-67fcb50f-a7bb-4102-9a52-c08b854d7d0e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:27.904908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-67fcb50f-a7bb-4102-9a52-c08b854d7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:28.006711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 629/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:47:28.029099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e8a6-ecdd-464a-8eca-2ed630808be2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:28.046901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:28.159168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9e8a6-ecdd-464a-8eca-2ed630808be2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:28.197957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27a514-9548-473f-b093-e6a5ae641ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:28.198856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a514-9548-473f-b093-e6a5ae641ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:28.199155 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a514-9548-473f-b093-e6a5ae641ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:28.199529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27a514-9548-473f-b093-e6a5ae641ef2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:28.212206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27a514-9548-473f-b093-e6a5ae641ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-cb27a514-9548-473f-b093-e6a5ae641ef2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:47:28.220653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:28.221872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:28.222887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 634/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:28.229288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcb50f-a7bb-4102-9a52-c08b854d7d0e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:28.250864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:28.349272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcb50f-a7bb-4102-9a52-c08b854d7d0e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:28.392714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28831-3cf6-441c-a713-7d8701f252ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:28.393429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28831-3cf6-441c-a713-7d8701f252ab None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:28.393710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28831-3cf6-441c-a713-7d8701f252ab None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:28.393986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28831-3cf6-441c-a713-7d8701f252ab None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:28.395574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28831-3cf6-441c-a713-7d8701f252ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:28.395885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28831-3cf6-441c-a713-7d8701f252ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:28.397328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28831-3cf6-441c-a713-7d8701f252ab None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:28.407434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 630/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:47:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:28.413823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27a514-9548-473f-b093-e6a5ae641ef2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:28.488109 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:28.535853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27a514-9548-473f-b093-e6a5ae641ef2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:28.573912 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706c6e8-5bc1-40a5-9a7f-9d7f6837cf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:28.574791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706c6e8-5bc1-40a5-9a7f-9d7f6837cf20 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:28.575086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706c6e8-5bc1-40a5-9a7f-9d7f6837cf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:28.575361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706c6e8-5bc1-40a5-9a7f-9d7f6837cf20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:28.587306 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706c6e8-5bc1-40a5-9a7f-9d7f6837cf20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:28.588836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706c6e8-5bc1-40a5-9a7f-9d7f6837cf20 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b706c6e8-5bc1-40a5-9a7f-9d7f6837cf20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:28.610540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:28.612355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:28.614179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:28.614179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:28.614179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:28.614179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:28.614179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 635/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:28.621970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28831-3cf6-441c-a713-7d8701f252ab None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:28.716618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:28.738530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28831-3cf6-441c-a713-7d8701f252ab None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:28.779582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e7477-19b7-415b-90e1-12637470d21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:28.780280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e7477-19b7-415b-90e1-12637470d21e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:28.780561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e7477-19b7-415b-90e1-12637470d21e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:28.780830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e7477-19b7-415b-90e1-12637470d21e None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:28.781587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e7477-19b7-415b-90e1-12637470d21e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:28.781894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e7477-19b7-415b-90e1-12637470d21e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:28.783343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e7477-19b7-415b-90e1-12637470d21e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:28.796652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 631/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:28.803423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706c6e8-5bc1-40a5-9a7f-9d7f6837cf20 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:28.928103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706c6e8-5bc1-40a5-9a7f-9d7f6837cf20 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:28.963456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:28.983093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aae516-7f12-4d81-8038-e573158e2f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:28.983960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aae516-7f12-4d81-8038-e573158e2f1e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:28.984245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aae516-7f12-4d81-8038-e573158e2f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:28.984528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aae516-7f12-4d81-8038-e573158e2f1e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:28.994370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aae516-7f12-4d81-8038-e573158e2f1e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:28.995906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aae516-7f12-4d81-8038-e573158e2f1e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-40aae516-7f12-4d81-8038-e573158e2f1e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:47:29.012668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:29.013897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:29.015090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 636/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 12:47:29.020575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e7477-19b7-415b-90e1-12637470d21e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:29.149992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e7477-19b7-415b-90e1-12637470d21e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:29.195027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21a577-6d54-44ef-ad08-c5c7747c6764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:29.195729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a577-6d54-44ef-ad08-c5c7747c6764 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:29.196015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a577-6d54-44ef-ad08-c5c7747c6764 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:29.196290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a577-6d54-44ef-ad08-c5c7747c6764 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:29.197148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21a577-6d54-44ef-ad08-c5c7747c6764 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:29.197475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21a577-6d54-44ef-ad08-c5c7747c6764 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:29.198993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21a577-6d54-44ef-ad08-c5c7747c6764 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:29.209351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:29.219562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 632/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 12:47:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:29.227920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aae516-7f12-4d81-8038-e573158e2f1e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:29.341075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aae516-7f12-4d81-8038-e573158e2f1e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:29.383338 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6392a-69eb-4357-9df2-4ffff2dca8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:29.384158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6392a-69eb-4357-9df2-4ffff2dca8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:29.384435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6392a-69eb-4357-9df2-4ffff2dca8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:29.384708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6392a-69eb-4357-9df2-4ffff2dca8a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:29.397511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6392a-69eb-4357-9df2-4ffff2dca8a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:29.399070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6392a-69eb-4357-9df2-4ffff2dca8a3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f2e6392a-69eb-4357-9df2-4ffff2dca8a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:29.418370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:29.419549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:29.420737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:29.420737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:29.420737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:29.420737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:29.420737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 637/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:29.427095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21a577-6d54-44ef-ad08-c5c7747c6764 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:29.544274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21a577-6d54-44ef-ad08-c5c7747c6764 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:29.588481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964e31b-fd73-449b-bce2-8c34a4391bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:29.589084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e31b-fd73-449b-bce2-8c34a4391bda None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:29.589368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e31b-fd73-449b-bce2-8c34a4391bda None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:29.589648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e31b-fd73-449b-bce2-8c34a4391bda None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:29.590920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964e31b-fd73-449b-bce2-8c34a4391bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:29.590920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964e31b-fd73-449b-bce2-8c34a4391bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:29.592169 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964e31b-fd73-449b-bce2-8c34a4391bda None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:29.605725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 633/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:29.611839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6392a-69eb-4357-9df2-4ffff2dca8a3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:29.650217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:29.735456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6392a-69eb-4357-9df2-4ffff2dca8a3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:29.775160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0db077-740e-466f-91d1-5a6f84365909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:29.776014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0db077-740e-466f-91d1-5a6f84365909 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:29.776299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0db077-740e-466f-91d1-5a6f84365909 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:29.776574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0db077-740e-466f-91d1-5a6f84365909 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:29.784434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0db077-740e-466f-91d1-5a6f84365909 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:29.786351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0db077-740e-466f-91d1-5a6f84365909 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7a0db077-740e-466f-91d1-5a6f84365909 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:47:29.803023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:29.804098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:29.805670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:47:29.805670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:47:29.805670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:47:29.805670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:47:29.805670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:47:29.805670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:47:29.805670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:29.805670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:29.805670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 638/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:47:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:29.810817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964e31b-fd73-449b-bce2-8c34a4391bda None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:29.894288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:29.951250 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964e31b-fd73-449b-bce2-8c34a4391bda None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:30.000074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9354d-ea58-4b8d-87a2-2ddd30bceb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:30.000785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9354d-ea58-4b8d-87a2-2ddd30bceb49 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:30.001069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9354d-ea58-4b8d-87a2-2ddd30bceb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:30.001342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9354d-ea58-4b8d-87a2-2ddd30bceb49 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:30.002187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9354d-ea58-4b8d-87a2-2ddd30bceb49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:30.002502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9354d-ea58-4b8d-87a2-2ddd30bceb49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:30.004091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9354d-ea58-4b8d-87a2-2ddd30bceb49 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:30.018407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 634/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:47:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:30.026614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0db077-740e-466f-91d1-5a6f84365909 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:30.127765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:30.138376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0db077-740e-466f-91d1-5a6f84365909 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:30.178149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793bb1f-1f2f-42b4-a2cf-7eb58fc9bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:30.178976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793bb1f-1f2f-42b4-a2cf-7eb58fc9bbf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:30.179256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793bb1f-1f2f-42b4-a2cf-7eb58fc9bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:30.179531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793bb1f-1f2f-42b4-a2cf-7eb58fc9bbf1 None admin] PATH_INFO: `/v3/projects/82c9d894195d4300849f8401a6af0d82/users/5d9781351e60447dbcbe4ee51322a3bc/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:30.181613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793bb1f-1f2f-42b4-a2cf-7eb58fc9bbf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=82c9d894195d4300849f8401a6af0d82, user_id=5d9781351e60447dbcbe4ee51322a3bc, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:30.183151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793bb1f-1f2f-42b4-a2cf-7eb58fc9bbf1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:30.199170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 639/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 17 12:47:30 2022] PUT /identity/v3/projects/82c9d894195d4300849f8401a6af0d82/users/5d9781351e60447dbcbe4ee51322a3bc/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:47:32.357079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74237-1abe-473f-83d6-9cd3a439f13d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:32.357679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74237-1abe-473f-83d6-9cd3a439f13d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:32.357679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74237-1abe-473f-83d6-9cd3a439f13d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:32.359067 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 635/1274] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:32.365010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da55cad-2cc2-4046-9d0b-d5f795c63d1f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:32.365893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da55cad-2cc2-4046-9d0b-d5f795c63d1f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:32.365893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da55cad-2cc2-4046-9d0b-d5f795c63d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:32.383899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7da55cad-2cc2-4046-9d0b-d5f795c63d1f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:32.385136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7da55cad-2cc2-4046-9d0b-d5f795c63d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:32.457103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 640/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:47:32.481477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74237-1abe-473f-83d6-9cd3a439f13d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:32.591025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74237-1abe-473f-83d6-9cd3a439f13d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:32.609960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:32.629408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b802bfd-0005-4bc7-a84d-e583e76149e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:32.630274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b802bfd-0005-4bc7-a84d-e583e76149e4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:32.630556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b802bfd-0005-4bc7-a84d-e583e76149e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:32.630827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b802bfd-0005-4bc7-a84d-e583e76149e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:32.641321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b802bfd-0005-4bc7-a84d-e583e76149e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3b802bfd-0005-4bc7-a84d-e583e76149e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 12:47:32.649930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:32.650971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:32.651954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 636/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 17 12:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:32.657951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da55cad-2cc2-4046-9d0b-d5f795c63d1f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:32.747344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:32.767628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da55cad-2cc2-4046-9d0b-d5f795c63d1f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:32.802638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561320d1-7e06-4c33-8760-7e3970dd0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:32.803324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561320d1-7e06-4c33-8760-7e3970dd0b39 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:32.803606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561320d1-7e06-4c33-8760-7e3970dd0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:32.803882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561320d1-7e06-4c33-8760-7e3970dd0b39 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:32.804626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561320d1-7e06-4c33-8760-7e3970dd0b39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:32.804928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561320d1-7e06-4c33-8760-7e3970dd0b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:32.806367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561320d1-7e06-4c33-8760-7e3970dd0b39 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:32.815153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 641/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 17 12:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:32.821366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b802bfd-0005-4bc7-a84d-e583e76149e4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:32.933006 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b802bfd-0005-4bc7-a84d-e583e76149e4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:32.973123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8fd3c-4520-46b4-88c7-f2516356ac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:32.973972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8fd3c-4520-46b4-88c7-f2516356ac6c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:32.974336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8fd3c-4520-46b4-88c7-f2516356ac6c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:32.974567 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8fd3c-4520-46b4-88c7-f2516356ac6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:32.987468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8fd3c-4520-46b4-88c7-f2516356ac6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:32.989388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8fd3c-4520-46b4-88c7-f2516356ac6c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-03e8fd3c-4520-46b4-88c7-f2516356ac6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:33.010702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:33.011899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:33.013610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:33.013610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:33.013610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:33.013610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:33.013610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 637/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:33.020609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561320d1-7e06-4c33-8760-7e3970dd0b39 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:33.131381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561320d1-7e06-4c33-8760-7e3970dd0b39 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:33.166002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb499c-7a40-45b7-b98c-00593f46edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:33.166706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb499c-7a40-45b7-b98c-00593f46edaa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:33.166992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb499c-7a40-45b7-b98c-00593f46edaa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:33.167264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb499c-7a40-45b7-b98c-00593f46edaa None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:33.167991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb499c-7a40-45b7-b98c-00593f46edaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:33.168288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb499c-7a40-45b7-b98c-00593f46edaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:33.169712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb499c-7a40-45b7-b98c-00593f46edaa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:33.182193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 642/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:33.188032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8fd3c-4520-46b4-88c7-f2516356ac6c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:33.221154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:33.293078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8fd3c-4520-46b4-88c7-f2516356ac6c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:33.328822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f686c1-62b8-43d9-b0d1-4f9b9d8921b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:33.329657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f686c1-62b8-43d9-b0d1-4f9b9d8921b3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:33.329921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f686c1-62b8-43d9-b0d1-4f9b9d8921b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:33.330242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f686c1-62b8-43d9-b0d1-4f9b9d8921b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:33.338845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f686c1-62b8-43d9-b0d1-4f9b9d8921b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:33.340329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f686c1-62b8-43d9-b0d1-4f9b9d8921b3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-94f686c1-62b8-43d9-b0d1-4f9b9d8921b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 12:47:33.356244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:33.357914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:33.359127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 638/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:33.363942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb499c-7a40-45b7-b98c-00593f46edaa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:33.368329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:33.476647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb499c-7a40-45b7-b98c-00593f46edaa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:33.514189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a6d66-f1a2-4f81-9347-74de58f46a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:33.514882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a6d66-f1a2-4f81-9347-74de58f46a5a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:33.515165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a6d66-f1a2-4f81-9347-74de58f46a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:33.515444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a6d66-f1a2-4f81-9347-74de58f46a5a None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:33.516370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a6d66-f1a2-4f81-9347-74de58f46a5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:33.516675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a6d66-f1a2-4f81-9347-74de58f46a5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:33.518168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a6d66-f1a2-4f81-9347-74de58f46a5a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:33.538966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 643/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 17 12:47:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:33.545208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f686c1-62b8-43d9-b0d1-4f9b9d8921b3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:33.643051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:33.653712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f686c1-62b8-43d9-b0d1-4f9b9d8921b3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:33.688803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54520dc7-3b3d-477a-ad3c-0346f022bad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:33.689476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520dc7-3b3d-477a-ad3c-0346f022bad3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:33.689760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520dc7-3b3d-477a-ad3c-0346f022bad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:33.690027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520dc7-3b3d-477a-ad3c-0346f022bad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:33.767555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54520dc7-3b3d-477a-ad3c-0346f022bad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:33.768938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54520dc7-3b3d-477a-ad3c-0346f022bad3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:33.860375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:33.872680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 639/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 17 12:47:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 12:47:33.879007 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a6d66-f1a2-4f81-9347-74de58f46a5a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:33.953874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:33.995959 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a6d66-f1a2-4f81-9347-74de58f46a5a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:34.030952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004f000-b53f-4a32-a446-919e45817f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:34.031667 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004f000-b53f-4a32-a446-919e45817f12 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:34.031944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004f000-b53f-4a32-a446-919e45817f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:34.032216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004f000-b53f-4a32-a446-919e45817f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:34.043056 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004f000-b53f-4a32-a446-919e45817f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:34.044535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004f000-b53f-4a32-a446-919e45817f12 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4004f000-b53f-4a32-a446-919e45817f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 12:47:34.063314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:34.064461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:34.065429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 12:47:34.065429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 12:47:34.065429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 12:47:34.065429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:34.065429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 644/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:34.070458 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54520dc7-3b3d-477a-ad3c-0346f022bad3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:34.176366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54520dc7-3b3d-477a-ad3c-0346f022bad3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:34.214286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73467bbd-4482-4623-ae4a-32f31f1fa0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:34.215071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73467bbd-4482-4623-ae4a-32f31f1fa0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:34.215358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73467bbd-4482-4623-ae4a-32f31f1fa0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:34.215637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73467bbd-4482-4623-ae4a-32f31f1fa0c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:34.216377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73467bbd-4482-4623-ae4a-32f31f1fa0c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:34.216689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73467bbd-4482-4623-ae4a-32f31f1fa0c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:34.218110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73467bbd-4482-4623-ae4a-32f31f1fa0c5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:34.231373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 640/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 17 12:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:34.237616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004f000-b53f-4a32-a446-919e45817f12 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:34.345127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004f000-b53f-4a32-a446-919e45817f12 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:34.360639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:34.384898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173ef58-79ca-4854-849f-90cad52e966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:34.385738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173ef58-79ca-4854-849f-90cad52e966e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:34.386025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173ef58-79ca-4854-849f-90cad52e966e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:34.386342 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173ef58-79ca-4854-849f-90cad52e966e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:34.396896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173ef58-79ca-4854-849f-90cad52e966e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:34.398453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173ef58-79ca-4854-849f-90cad52e966e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5173ef58-79ca-4854-849f-90cad52e966e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 12:47:34.413801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:34.414981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:34.415917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 12:47:34.415917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 12:47:34.415917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 12:47:34.415917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 12:47:34.415917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 12:47:34.415917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 12:47:34.415917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 12:47:34.415917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Jun 17 12:47:34.415917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 645/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 17 12:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:34.421423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73467bbd-4482-4623-ae4a-32f31f1fa0c5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:34.476392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:34.531131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73467bbd-4482-4623-ae4a-32f31f1fa0c5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:34.569243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea701c4d-354b-435a-a789-b881175def93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:34.569830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701c4d-354b-435a-a789-b881175def93 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:34.570158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701c4d-354b-435a-a789-b881175def93 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:34.570432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea701c4d-354b-435a-a789-b881175def93 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:34.571233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea701c4d-354b-435a-a789-b881175def93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:34.571543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea701c4d-354b-435a-a789-b881175def93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:34.572994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea701c4d-354b-435a-a789-b881175def93 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:34.586665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 641/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 17 12:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:34.593383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173ef58-79ca-4854-849f-90cad52e966e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:34.704308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173ef58-79ca-4854-849f-90cad52e966e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:34.742922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403ec67-fb51-43a3-bb41-5c603b8de161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:34.743601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403ec67-fb51-43a3-bb41-5c603b8de161 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:34.743885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403ec67-fb51-43a3-bb41-5c603b8de161 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:34.744168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403ec67-fb51-43a3-bb41-5c603b8de161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:34.745017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403ec67-fb51-43a3-bb41-5c603b8de161 None admin] RBAC: Adding query filter params (role.id=4ed7510dfda84b919d68cb8b2bab2916, scope.project.id=82c9d894195d4300849f8401a6af0d82, user.id=5d9781351e60447dbcbe4ee51322a3bc) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:34.745326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403ec67-fb51-43a3-bb41-5c603b8de161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:34.746845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403ec67-fb51-43a3-bb41-5c603b8de161 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:34.753165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 646/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 17 12:47:34 2022] GET /identity/v3/role_assignments?user.id=5d9781351e60447dbcbe4ee51322a3bc&scope.project.id=82c9d894195d4300849f8401a6af0d82&role.id=4ed7510dfda84b919d68cb8b2bab2916 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:36.915647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1432bc-9479-4e90-84e7-8e1d5defc3c4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:36.916371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1432bc-9479-4e90-84e7-8e1d5defc3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:36.916371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1432bc-9479-4e90-84e7-8e1d5defc3c4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:36.917664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 642/1288] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:36.924124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6ebf-da24-4efe-8886-f88ff034bcce None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:36.924638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6ebf-da24-4efe-8886-f88ff034bcce None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:36.924745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6ebf-da24-4efe-8886-f88ff034bcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:36.943967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f0cd6ebf-da24-4efe-8886-f88ff034bcce None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:36.945313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f0cd6ebf-da24-4efe-8886-f88ff034bcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:36.984326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:37.026700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 647/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 12:47:37.049275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1432bc-9479-4e90-84e7-8e1d5defc3c4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:37.161569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1432bc-9479-4e90-84e7-8e1d5defc3c4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:37.173257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:37.199358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f7597-4f09-4416-bb57-4a91f90c67f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:37.200185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f7597-4f09-4416-bb57-4a91f90c67f6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:37.200587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f7597-4f09-4416-bb57-4a91f90c67f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:37.200840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f7597-4f09-4416-bb57-4a91f90c67f6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:37.201500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f7597-4f09-4416-bb57-4a91f90c67f6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:37.202946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f7597-4f09-4416-bb57-4a91f90c67f6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-414f7597-4f09-4416-bb57-4a91f90c67f6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:37.216166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:37.217304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:37.218243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 643/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:47:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:37.223804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6ebf-da24-4efe-8886-f88ff034bcce None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:37.325661 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6ebf-da24-4efe-8886-f88ff034bcce None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:37.361434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0694e-0d8c-43e7-93f3-7fcacb26e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:37.362119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0694e-0d8c-43e7-93f3-7fcacb26e3fe None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:37.362421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0694e-0d8c-43e7-93f3-7fcacb26e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:37.362724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0694e-0d8c-43e7-93f3-7fcacb26e3fe None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:37.363440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0694e-0d8c-43e7-93f3-7fcacb26e3fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:37.363754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0694e-0d8c-43e7-93f3-7fcacb26e3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:37.365175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0694e-0d8c-43e7-93f3-7fcacb26e3fe None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:37.370586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 648/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 17 12:47:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:37.376857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f7597-4f09-4416-bb57-4a91f90c67f6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:37.484422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f7597-4f09-4416-bb57-4a91f90c67f6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:37.520045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae5a56-6496-48ab-b88d-7a2fa5aa3d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:37.520737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae5a56-6496-48ab-b88d-7a2fa5aa3d15 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:37.521026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae5a56-6496-48ab-b88d-7a2fa5aa3d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:37.521296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae5a56-6496-48ab-b88d-7a2fa5aa3d15 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:37.522013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae5a56-6496-48ab-b88d-7a2fa5aa3d15 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:37.522347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae5a56-6496-48ab-b88d-7a2fa5aa3d15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:37.523742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae5a56-6496-48ab-b88d-7a2fa5aa3d15 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:37.528641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 644/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 17 12:47:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:39.670157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f69a3-53ab-4a77-b50f-1502aab923ce None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:39.670727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f69a3-53ab-4a77-b50f-1502aab923ce None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:39.670727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f69a3-53ab-4a77-b50f-1502aab923ce None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:39.672083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 649/1293] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:39.677611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac819be7-3f03-4672-af19-768e644ffaf9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:39.678171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac819be7-3f03-4672-af19-768e644ffaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:39.678278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac819be7-3f03-4672-af19-768e644ffaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:39.695616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ac819be7-3f03-4672-af19-768e644ffaf9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:39.696861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ac819be7-3f03-4672-af19-768e644ffaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:39.727572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:39.766231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 645/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:47:39.789582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f69a3-53ab-4a77-b50f-1502aab923ce None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:39.823292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:39.895991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f69a3-53ab-4a77-b50f-1502aab923ce None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:39.935005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f048a67-c649-40b3-957a-fb5b303fedfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:39.935738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f048a67-c649-40b3-957a-fb5b303fedfb None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:39.936047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f048a67-c649-40b3-957a-fb5b303fedfb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:39.936419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f048a67-c649-40b3-957a-fb5b303fedfb None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:39.937183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f048a67-c649-40b3-957a-fb5b303fedfb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:39.938776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f048a67-c649-40b3-957a-fb5b303fedfb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:39.955144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 650/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 17 12:47:39 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:47:42.132590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57279-1bbd-4bb4-8a47-77747d6992b5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:42.133176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57279-1bbd-4bb4-8a47-77747d6992b5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:42.133176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57279-1bbd-4bb4-8a47-77747d6992b5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:42.134694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 646/1296] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:42.141643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa0fe3-1a1f-4c86-99e7-fb77441abf69 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:42.142189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa0fe3-1a1f-4c86-99e7-fb77441abf69 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:42.142189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa0fe3-1a1f-4c86-99e7-fb77441abf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:42.162600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-23fa0fe3-1a1f-4c86-99e7-fb77441abf69 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:42.164574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-23fa0fe3-1a1f-4c86-99e7-fb77441abf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:42.251849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 651/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:47:42.276031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57279-1bbd-4bb4-8a47-77747d6992b5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:42.408455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57279-1bbd-4bb4-8a47-77747d6992b5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:42.443461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b748181-2f54-4cd7-9065-85206748a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:42.444298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b748181-2f54-4cd7-9065-85206748a70b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:42.444574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b748181-2f54-4cd7-9065-85206748a70b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:42.444847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b748181-2f54-4cd7-9065-85206748a70b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:42.445511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b748181-2f54-4cd7-9065-85206748a70b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:42.446930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b748181-2f54-4cd7-9065-85206748a70b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8b748181-2f54-4cd7-9065-85206748a70b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:42.460467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:42.461742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:42.462991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 647/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:47:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:42.468221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa0fe3-1a1f-4c86-99e7-fb77441abf69 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:42.491431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:42.588222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa0fe3-1a1f-4c86-99e7-fb77441abf69 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:42.625513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb87413-6ed1-4266-83b0-fc1a7b51b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:42.626213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb87413-6ed1-4266-83b0-fc1a7b51b915 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:42.626491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb87413-6ed1-4266-83b0-fc1a7b51b915 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:42.626763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb87413-6ed1-4266-83b0-fc1a7b51b915 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:42.627466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb87413-6ed1-4266-83b0-fc1a7b51b915 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:42.627768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb87413-6ed1-4266-83b0-fc1a7b51b915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:42.629293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb87413-6ed1-4266-83b0-fc1a7b51b915 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:42.634904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 652/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 17 12:47:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:42.641526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b748181-2f54-4cd7-9065-85206748a70b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:42.685126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:42.766205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b748181-2f54-4cd7-9065-85206748a70b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:42.801825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ef6ad-b89d-422b-9178-541c746072af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:42.802737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ef6ad-b89d-422b-9178-541c746072af None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:42.803083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ef6ad-b89d-422b-9178-541c746072af None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:42.803395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ef6ad-b89d-422b-9178-541c746072af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:42.804245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ef6ad-b89d-422b-9178-541c746072af None admin] RBAC: Adding query filter params (interface=public, service_id=5326c0afe5e8490ca5528fc448df16e7, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:42.804590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ef6ad-b89d-422b-9178-541c746072af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:42.806049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ef6ad-b89d-422b-9178-541c746072af None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:42.811700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 648/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 17 12:47:42 2022] GET /identity/v3/endpoints?service_id=5326c0afe5e8490ca5528fc448df16e7&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:42.818271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb87413-6ed1-4266-83b0-fc1a7b51b915 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:42.914676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:42.937679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb87413-6ed1-4266-83b0-fc1a7b51b915 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:42.983628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce5e00-6f2b-47fb-a6ac-01acc3816e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:42.984663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce5e00-6f2b-47fb-a6ac-01acc3816e20 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:42.985087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce5e00-6f2b-47fb-a6ac-01acc3816e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:42.985422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce5e00-6f2b-47fb-a6ac-01acc3816e20 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:42.986490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce5e00-6f2b-47fb-a6ac-01acc3816e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:42.987826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce5e00-6f2b-47fb-a6ac-01acc3816e20 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:42.995935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 653/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 17 12:47:42 2022] GET /identity/v3/services => generated 2191 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:47:45.170505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5e0e-2943-4e7c-b07a-033540e0e1fe None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:45.171242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5e0e-2943-4e7c-b07a-033540e0e1fe None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:45.171242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5e0e-2943-4e7c-b07a-033540e0e1fe None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:45.172661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 649/1302] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:47:45.178743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4297c-f364-4c7a-9e4b-effa467cefe8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:45.179219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4297c-f364-4c7a-9e4b-effa467cefe8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:45.179313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4297c-f364-4c7a-9e4b-effa467cefe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:45.198673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b6a4297c-f364-4c7a-9e4b-effa467cefe8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:47:45.200161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b6a4297c-f364-4c7a-9e4b-effa467cefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:47:45.273063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 654/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:47:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 12:47:45.296647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f5e0e-2943-4e7c-b07a-033540e0e1fe None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:45.406642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:45.415142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f5e0e-2943-4e7c-b07a-033540e0e1fe None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:45.456790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf502b7-1ee9-4b59-9ada-7ee3dbdbed9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:45.457937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf502b7-1ee9-4b59-9ada-7ee3dbdbed9b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:45.458401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf502b7-1ee9-4b59-9ada-7ee3dbdbed9b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:45.458822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf502b7-1ee9-4b59-9ada-7ee3dbdbed9b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:45.459850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf502b7-1ee9-4b59-9ada-7ee3dbdbed9b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:45.462278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf502b7-1ee9-4b59-9ada-7ee3dbdbed9b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-fdf502b7-1ee9-4b59-9ada-7ee3dbdbed9b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 12:47:45.481033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 12:47:45.482196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Jun 17 12:47:45.483183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 650/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 17 12:47:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 12:47:45.489698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4297c-f364-4c7a-9e4b-effa467cefe8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:45.587415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:45.612379 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4297c-f364-4c7a-9e4b-effa467cefe8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:45.650503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a5c9a-45e7-401e-94b6-94fed18cb88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:45.651200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a5c9a-45e7-401e-94b6-94fed18cb88b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:45.651588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a5c9a-45e7-401e-94b6-94fed18cb88b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:45.651759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a5c9a-45e7-401e-94b6-94fed18cb88b None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:45.652465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a5c9a-45e7-401e-94b6-94fed18cb88b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:47:45.652766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a5c9a-45e7-401e-94b6-94fed18cb88b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:45.654217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a5c9a-45e7-401e-94b6-94fed18cb88b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:45.660387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 655/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 17 12:47:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:47:45.666629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf502b7-1ee9-4b59-9ada-7ee3dbdbed9b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:47:45.777357 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf502b7-1ee9-4b59-9ada-7ee3dbdbed9b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:47:45.813100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120a68e-ed83-4c45-8a1b-c829f3c7dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:47:45.813783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a68e-ed83-4c45-8a1b-c829f3c7dc05 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:47:45.814048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a68e-ed83-4c45-8a1b-c829f3c7dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:47:45.814400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a68e-ed83-4c45-8a1b-c829f3c7dc05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:47:45.815157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120a68e-ed83-4c45-8a1b-c829f3c7dc05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:47:45.816672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120a68e-ed83-4c45-8a1b-c829f3c7dc05 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:47:45.838952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 651/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 17 12:47:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:47:55.660017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=30 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:47:55.833888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:48:50.226073 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda12f53-2b63-4d78-b65b-b88b0e7c5405 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:50.226651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda12f53-2b63-4d78-b65b-b88b0e7c5405 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:50.227049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda12f53-2b63-4d78-b65b-b88b0e7c5405 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:50.234928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a17f9-5e3f-4b72-aeb2-19341953cf15 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:50.235466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a17f9-5e3f-4b72-aeb2-19341953cf15 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:50.235466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a17f9-5e3f-4b72-aeb2-19341953cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:50.239869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 656/1307] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:48:50 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:48:50.326590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0e4a17f9-5e3f-4b72-aeb2-19341953cf15 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:48:50.327819 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0e4a17f9-5e3f-4b72-aeb2-19341953cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:50.454499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 652/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:48:50.496346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebd6c5-cf47-4d4d-b4fa-8692da74a370 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:50.496535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebd6c5-cf47-4d4d-b4fa-8692da74a370 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:50.496819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebd6c5-cf47-4d4d-b4fa-8692da74a370 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:50.498824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 657/1309] 10.222.0.48 () {54 vars in 964 bytes} [Fri Jun 17 12:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:48:50.505799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fa760-671b-40d6-b297-129876c08919 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:50.506196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fa760-671b-40d6-b297-129876c08919 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:50.506555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fa760-671b-40d6-b297-129876c08919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:50.588467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ac9fa760-671b-40d6-b297-129876c08919 None None] MFA Rules not processed for user `688ecef411094633927ffd663ffa1818`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:48:50.589711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ac9fa760-671b-40d6-b297-129876c08919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:50.618723 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:48:50.720737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 653/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Jun 17 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:48:50.730714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebd6c5-cf47-4d4d-b4fa-8692da74a370 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:48:50.732483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-beebd6c5-cf47-4d4d-b4fa-8692da74a370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:50.872785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebd6c5-cf47-4d4d-b4fa-8692da74a370 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:48:50.961604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4ef91-d4b1-49f1-8d58-d5f834066ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:48:50.962660 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4ef91-d4b1-49f1-8d58-d5f834066ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:50.963105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4ef91-d4b1-49f1-8d58-d5f834066ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:50.963539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4ef91-d4b1-49f1-8d58-d5f834066ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:50.965433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d2a4ef91-d4b1-49f1-8d58-d5f834066ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:51.028295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:48:51.094361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4ef91-d4b1-49f1-8d58-d5f834066ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:48:51.095856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4ef91-d4b1-49f1-8d58-d5f834066ea5 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:48:51.118031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 658/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:48:53.561789 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651035de-7b4c-47c5-b9d8-473eed70ff41 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:53.562549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651035de-7b4c-47c5-b9d8-473eed70ff41 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:53.562549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651035de-7b4c-47c5-b9d8-473eed70ff41 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:53.566252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 654/1312] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:48:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:48:53.572982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ba85-7181-46cd-9f40-99d231621eaf None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:53.573498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ba85-7181-46cd-9f40-99d231621eaf None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:53.573936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ba85-7181-46cd-9f40-99d231621eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:53.682732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7ea5ba85-7181-46cd-9f40-99d231621eaf None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:48:53.684016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7ea5ba85-7181-46cd-9f40-99d231621eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:53.809236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 659/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:48:53.849833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651035de-7b4c-47c5-b9d8-473eed70ff41 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:48:53.851470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-651035de-7b4c-47c5-b9d8-473eed70ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:53.980746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651035de-7b4c-47c5-b9d8-473eed70ff41 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:48:54.058184 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:48:54.061042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba34953-fbcc-4d2f-ae07-acef9d7daa84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:48:54.061836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba34953-fbcc-4d2f-ae07-acef9d7daa84 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:54.062319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba34953-fbcc-4d2f-ae07-acef9d7daa84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:54.062672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba34953-fbcc-4d2f-ae07-acef9d7daa84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:54.064579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1ba34953-fbcc-4d2f-ae07-acef9d7daa84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:54.198061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba34953-fbcc-4d2f-ae07-acef9d7daa84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:48:54.199602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba34953-fbcc-4d2f-ae07-acef9d7daa84 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:48:54.221510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 655/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:48:56.727964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446b00a-875a-4d7d-a318-0d6547f4a324 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:56.728543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446b00a-875a-4d7d-a318-0d6547f4a324 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:56.728543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446b00a-875a-4d7d-a318-0d6547f4a324 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:56.729916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 660/1315] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:48:56.735590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76e716-a6b7-43c7-90b8-3b5022dbca93 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:56.736034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76e716-a6b7-43c7-90b8-3b5022dbca93 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:56.736172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76e716-a6b7-43c7-90b8-3b5022dbca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:56.817163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7d76e716-a6b7-43c7-90b8-3b5022dbca93 None None] MFA Rules not processed for user `9d6b6818f3464d67ac88d0437368dd05`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:48:56.818510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7d76e716-a6b7-43c7-90b8-3b5022dbca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:56.876763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:48:56.924837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 656/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:48:56.965446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446b00a-875a-4d7d-a318-0d6547f4a324 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:48:56.967190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6446b00a-875a-4d7d-a318-0d6547f4a324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:56.978066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:48:57.091589 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446b00a-875a-4d7d-a318-0d6547f4a324 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:48:57.169518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d97b4-2a4a-4db8-a0cc-d35e5bfea46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:48:57.170206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d97b4-2a4a-4db8-a0cc-d35e5bfea46c service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:48:57.170485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d97b4-2a4a-4db8-a0cc-d35e5bfea46c service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:48:57.170752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d97b4-2a4a-4db8-a0cc-d35e5bfea46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:48:57.172415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d73d97b4-2a4a-4db8-a0cc-d35e5bfea46c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:48:57.248332 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:48:57.297307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d97b4-2a4a-4db8-a0cc-d35e5bfea46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:48:57.298845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d97b4-2a4a-4db8-a0cc-d35e5bfea46c service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:48:57.319755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 661/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:48:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:00.033774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a0fe3-58c7-4c4a-a509-0556bbf1a340 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:00.034493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a0fe3-58c7-4c4a-a509-0556bbf1a340 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:00.034493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a0fe3-58c7-4c4a-a509-0556bbf1a340 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:00.035790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 657/1318] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:00.041278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d92480-4aec-4246-b361-7ce45ee6ad4b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:00.041766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d92480-4aec-4246-b361-7ce45ee6ad4b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:00.041870 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d92480-4aec-4246-b361-7ce45ee6ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:00.106727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-38d92480-4aec-4246-b361-7ce45ee6ad4b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:00.107927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-38d92480-4aec-4246-b361-7ce45ee6ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:00.206183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 662/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:00.246168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a0fe3-58c7-4c4a-a509-0556bbf1a340 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:00.247724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f68a0fe3-58c7-4c4a-a509-0556bbf1a340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:00.356327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a0fe3-58c7-4c4a-a509-0556bbf1a340 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:00.438013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76f7d4-036a-4d95-8056-1ac31a73e004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:00.438734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76f7d4-036a-4d95-8056-1ac31a73e004 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:00.439016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76f7d4-036a-4d95-8056-1ac31a73e004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:00.439295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76f7d4-036a-4d95-8056-1ac31a73e004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:00.440971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f76f7d4-036a-4d95-8056-1ac31a73e004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:00.449541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:00.555979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76f7d4-036a-4d95-8056-1ac31a73e004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:00.557460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76f7d4-036a-4d95-8056-1ac31a73e004 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:00.576558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 658/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:03.431569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb098d97-d8aa-4ac3-a256-10bf85a89d59 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:03.432271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb098d97-d8aa-4ac3-a256-10bf85a89d59 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:03.432271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb098d97-d8aa-4ac3-a256-10bf85a89d59 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:03.433757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 663/1321] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:03.439743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c4995-58bd-4456-8567-b784cba45af7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:03.440308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c4995-58bd-4456-8567-b784cba45af7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:03.440308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c4995-58bd-4456-8567-b784cba45af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:03.510978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-895c4995-58bd-4456-8567-b784cba45af7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:03.512191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-895c4995-58bd-4456-8567-b784cba45af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:03.580556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:03.625560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 659/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:03.675991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91c1f-ef31-4402-9958-498fb477fd14 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:03.676249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91c1f-ef31-4402-9958-498fb477fd14 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:03.676541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91c1f-ef31-4402-9958-498fb477fd14 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:03.678434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 664/1323] 10.222.0.48 () {54 vars in 964 bytes} [Fri Jun 17 12:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:03.687121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f98ca1-cdf3-4f16-8512-d35138921740 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:03.687573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f98ca1-cdf3-4f16-8512-d35138921740 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:03.687761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f98ca1-cdf3-4f16-8512-d35138921740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:03.777540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-82f98ca1-cdf3-4f16-8512-d35138921740 None None] MFA Rules not processed for user `688ecef411094633927ffd663ffa1818`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:03.778811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-82f98ca1-cdf3-4f16-8512-d35138921740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:03.860137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 660/1324] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Jun 17 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:03.869864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f91c1f-ef31-4402-9958-498fb477fd14 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:03.871551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-33f91c1f-ef31-4402-9958-498fb477fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:03.893128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:03.988025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f91c1f-ef31-4402-9958-498fb477fd14 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:04.069336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcc4f-7d6f-44fb-8117-2a264aa2eb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:04.070010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcc4f-7d6f-44fb-8117-2a264aa2eb12 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:04.070323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcc4f-7d6f-44fb-8117-2a264aa2eb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:04.070603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcc4f-7d6f-44fb-8117-2a264aa2eb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:04.072275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0babcc4f-7d6f-44fb-8117-2a264aa2eb12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:04.153356 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:04.193458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babcc4f-7d6f-44fb-8117-2a264aa2eb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:04.195124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babcc4f-7d6f-44fb-8117-2a264aa2eb12 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:04.217276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 665/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:06.724013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13b6d-64b3-4572-bb12-5ba658db2386 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:06.724952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13b6d-64b3-4572-bb12-5ba658db2386 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:06.725246 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13b6d-64b3-4572-bb12-5ba658db2386 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:06.726699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 661/1326] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:06.732765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc77221-4074-43a0-9bd3-a35e54d639c4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:06.733305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc77221-4074-43a0-9bd3-a35e54d639c4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:06.733514 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc77221-4074-43a0-9bd3-a35e54d639c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:06.814243 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ccc77221-4074-43a0-9bd3-a35e54d639c4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:06.815478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ccc77221-4074-43a0-9bd3-a35e54d639c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:06.921223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 666/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:06.957019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13b6d-64b3-4572-bb12-5ba658db2386 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:06.958707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4fb13b6d-64b3-4572-bb12-5ba658db2386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:07.024659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:07.070324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13b6d-64b3-4572-bb12-5ba658db2386 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:07.148044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadbb89-e17d-40a6-95db-5cfb80b5d554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:07.148724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadbb89-e17d-40a6-95db-5cfb80b5d554 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:07.149008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadbb89-e17d-40a6-95db-5cfb80b5d554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:07.149285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadbb89-e17d-40a6-95db-5cfb80b5d554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:07.151131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7cadbb89-e17d-40a6-95db-5cfb80b5d554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:07.261054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:07.263819 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadbb89-e17d-40a6-95db-5cfb80b5d554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:07.265564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadbb89-e17d-40a6-95db-5cfb80b5d554 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:07.285396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 662/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:09.488768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebbe48-a4a8-491b-be63-3eef0b4177af None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:09.489351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebbe48-a4a8-491b-be63-3eef0b4177af None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:09.489351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebbe48-a4a8-491b-be63-3eef0b4177af None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:09.491169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 667/1329] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:09.496824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cfc47-0de7-4f6b-bb12-d9bfccf8a723 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:09.497297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cfc47-0de7-4f6b-bb12-d9bfccf8a723 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:09.497399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cfc47-0de7-4f6b-bb12-d9bfccf8a723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:09.564879 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-703cfc47-0de7-4f6b-bb12-d9bfccf8a723 None None] MFA Rules not processed for user `9d6b6818f3464d67ac88d0437368dd05`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:09.566125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-703cfc47-0de7-4f6b-bb12-d9bfccf8a723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:09.673795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 663/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:09.711707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebbe48-a4a8-491b-be63-3eef0b4177af None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:09.713369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e4ebbe48-a4a8-491b-be63-3eef0b4177af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:09.747592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:09.824594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebbe48-a4a8-491b-be63-3eef0b4177af None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:09.906708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaebbf4-231c-40ff-97e6-4b967b5f3f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:09.907382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaebbf4-231c-40ff-97e6-4b967b5f3f8b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:09.907678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaebbf4-231c-40ff-97e6-4b967b5f3f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:09.907943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaebbf4-231c-40ff-97e6-4b967b5f3f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:09.909618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-baaebbf4-231c-40ff-97e6-4b967b5f3f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:09.994823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:10.029767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaebbf4-231c-40ff-97e6-4b967b5f3f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:10.031308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaebbf4-231c-40ff-97e6-4b967b5f3f8b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:10.052940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 668/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:12.629135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd77c-2ba4-4900-95be-b6f2d59397bc None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:12.629722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd77c-2ba4-4900-95be-b6f2d59397bc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:12.629722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd77c-2ba4-4900-95be-b6f2d59397bc None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:12.631279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 664/1332] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:12.636882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035ae7e-2fd8-479a-b336-4a382f5fdf1b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:12.637348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035ae7e-2fd8-479a-b336-4a382f5fdf1b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:12.637614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035ae7e-2fd8-479a-b336-4a382f5fdf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:12.708853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e035ae7e-2fd8-479a-b336-4a382f5fdf1b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:12.710121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e035ae7e-2fd8-479a-b336-4a382f5fdf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:12.817053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 669/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:12.853013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd77c-2ba4-4900-95be-b6f2d59397bc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:12.854600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-36edd77c-2ba4-4900-95be-b6f2d59397bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:12.931296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:12.969957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd77c-2ba4-4900-95be-b6f2d59397bc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:13.045433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40d972-1a3a-4017-b164-5aada2026f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:13.046125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40d972-1a3a-4017-b164-5aada2026f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:13.046399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40d972-1a3a-4017-b164-5aada2026f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:13.046698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40d972-1a3a-4017-b164-5aada2026f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:13.048343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3e40d972-1a3a-4017-b164-5aada2026f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:13.168494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40d972-1a3a-4017-b164-5aada2026f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:13.169959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40d972-1a3a-4017-b164-5aada2026f66 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:13.180301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:13.190116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 665/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:15.410856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f731dda-bf17-4562-adb6-04e05f730483 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:15.411862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f731dda-bf17-4562-adb6-04e05f730483 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:15.411862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f731dda-bf17-4562-adb6-04e05f730483 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:15.412789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 670/1335] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:15.418556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603cd90-f60a-4d9b-9cc9-774ff4807d19 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:15.419021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603cd90-f60a-4d9b-9cc9-774ff4807d19 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:15.419139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603cd90-f60a-4d9b-9cc9-774ff4807d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:15.484679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9603cd90-f60a-4d9b-9cc9-774ff4807d19 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:15.485896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9603cd90-f60a-4d9b-9cc9-774ff4807d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:15.586422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 666/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:15.626883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f731dda-bf17-4562-adb6-04e05f730483 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:15.628449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5f731dda-bf17-4562-adb6-04e05f730483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:15.671783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:15.740450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f731dda-bf17-4562-adb6-04e05f730483 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:15.818741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d24a9-dafa-4bd0-be79-86bb532aae71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:15.819411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d24a9-dafa-4bd0-be79-86bb532aae71 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:15.819699 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d24a9-dafa-4bd0-be79-86bb532aae71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:15.819983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d24a9-dafa-4bd0-be79-86bb532aae71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:15.821659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d52d24a9-dafa-4bd0-be79-86bb532aae71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:15.911335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:15.940323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d24a9-dafa-4bd0-be79-86bb532aae71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:15.941818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d24a9-dafa-4bd0-be79-86bb532aae71 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:15.962606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 671/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:18.564443 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dace312-077f-470c-9e0c-7b9325f73f6c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:18.565023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dace312-077f-470c-9e0c-7b9325f73f6c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:18.565023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dace312-077f-470c-9e0c-7b9325f73f6c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:18.566421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 667/1338] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:18.572353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8061e6-be6d-463e-9dff-82ad32873060 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:18.572811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8061e6-be6d-463e-9dff-82ad32873060 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:18.572950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8061e6-be6d-463e-9dff-82ad32873060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:18.641946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ab8061e6-be6d-463e-9dff-82ad32873060 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:18.643240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ab8061e6-be6d-463e-9dff-82ad32873060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:18.753227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 672/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:18.789890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dace312-077f-470c-9e0c-7b9325f73f6c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:18.791499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2dace312-077f-470c-9e0c-7b9325f73f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:18.874839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:18.904906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dace312-077f-470c-9e0c-7b9325f73f6c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:18.987804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1d68a-6ac0-4b41-ac32-b6e164d46dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:18.988754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1d68a-6ac0-4b41-ac32-b6e164d46dff service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:18.989145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1d68a-6ac0-4b41-ac32-b6e164d46dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:18.989707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1d68a-6ac0-4b41-ac32-b6e164d46dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:18.992781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c3b1d68a-6ac0-4b41-ac32-b6e164d46dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:19.135533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1d68a-6ac0-4b41-ac32-b6e164d46dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:19.137064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1d68a-6ac0-4b41-ac32-b6e164d46dff service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:19.157465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 668/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:23.487983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152fa74-ef0b-445e-bdda-3976a5efce7a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:23.488533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152fa74-ef0b-445e-bdda-3976a5efce7a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:23.488533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152fa74-ef0b-445e-bdda-3976a5efce7a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:23.490011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 673/1341] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:23.495898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3fe19-e6b2-4722-860c-013707fb0a5a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:23.496425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3fe19-e6b2-4722-860c-013707fb0a5a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:23.496425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3fe19-e6b2-4722-860c-013707fb0a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:23.503089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:23.571992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-91a3fe19-e6b2-4722-860c-013707fb0a5a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:23.573977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-91a3fe19-e6b2-4722-860c-013707fb0a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:23.691917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 669/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:23.730963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152fa74-ef0b-445e-bdda-3976a5efce7a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:23.733424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9152fa74-ef0b-445e-bdda-3976a5efce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:23.793296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:23.842560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152fa74-ef0b-445e-bdda-3976a5efce7a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:23.846427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053512e-fff9-42a1-894b-41dd56b79500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:23.847099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053512e-fff9-42a1-894b-41dd56b79500 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:23.847383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053512e-fff9-42a1-894b-41dd56b79500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:23.847658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053512e-fff9-42a1-894b-41dd56b79500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:23.857407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053512e-fff9-42a1-894b-41dd56b79500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:23.858925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053512e-fff9-42a1-894b-41dd56b79500 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:23.869028 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 674/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:49:26.637388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6cc1b-8c81-43a6-a1e2-d2f23d6e3107 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:26.638063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6cc1b-8c81-43a6-a1e2-d2f23d6e3107 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:26.638063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6cc1b-8c81-43a6-a1e2-d2f23d6e3107 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:26.639413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 670/1344] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:26.645437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac4ba-d542-4886-ab6e-d97703ba6548 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:26.646062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac4ba-d542-4886-ab6e-d97703ba6548 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:26.646476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac4ba-d542-4886-ab6e-d97703ba6548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:26.682013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3e7ac4ba-d542-4886-ab6e-d97703ba6548 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:26.683281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3e7ac4ba-d542-4886-ab6e-d97703ba6548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:26.772019 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 675/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:26.809782 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6cc1b-8c81-43a6-a1e2-d2f23d6e3107 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:26.821002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6cc1b-8c81-43a6-a1e2-d2f23d6e3107 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:26.825099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a26aae-592d-42bf-ab76-458fa94f721f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:26.825744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a26aae-592d-42bf-ab76-458fa94f721f service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:26.826018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a26aae-592d-42bf-ab76-458fa94f721f service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:26.826340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a26aae-592d-42bf-ab76-458fa94f721f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:26.836078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a26aae-592d-42bf-ab76-458fa94f721f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:26.837546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a26aae-592d-42bf-ab76-458fa94f721f service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:26.847383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 671/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:31.001207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf75455-6f35-48b3-817b-8d6fb55b3d25 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:31.001846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf75455-6f35-48b3-817b-8d6fb55b3d25 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:31.001846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf75455-6f35-48b3-817b-8d6fb55b3d25 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:31.003599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 676/1347] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:31.008545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecc2d7-0af8-47db-adb9-f392c9dcc574 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:31.009045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecc2d7-0af8-47db-adb9-f392c9dcc574 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:31.009157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecc2d7-0af8-47db-adb9-f392c9dcc574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:31.028144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-16ecc2d7-0af8-47db-adb9-f392c9dcc574 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:31.029244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-16ecc2d7-0af8-47db-adb9-f392c9dcc574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:31.037827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 672/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:31.075186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf75455-6f35-48b3-817b-8d6fb55b3d25 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:31.087083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf75455-6f35-48b3-817b-8d6fb55b3d25 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:31.090816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19ee25-0c2f-4e60-8223-3a93e31c7db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:31.091473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19ee25-0c2f-4e60-8223-3a93e31c7db9 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:31.091757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19ee25-0c2f-4e60-8223-3a93e31c7db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:31.092038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19ee25-0c2f-4e60-8223-3a93e31c7db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:31.102344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19ee25-0c2f-4e60-8223-3a93e31c7db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:31.103882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19ee25-0c2f-4e60-8223-3a93e31c7db9 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:31.113795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 677/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:36.274310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58d2b1-7395-4d05-8cb7-d13c8ac73219 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:36.274871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58d2b1-7395-4d05-8cb7-d13c8ac73219 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:36.274871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58d2b1-7395-4d05-8cb7-d13c8ac73219 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:36.276845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 673/1350] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 12:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:36.281892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90473e68-989c-4c5b-a471-e0c65dc51a45 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:36.282353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90473e68-989c-4c5b-a471-e0c65dc51a45 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:36.282583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90473e68-989c-4c5b-a471-e0c65dc51a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:36.360600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-90473e68-989c-4c5b-a471-e0c65dc51a45 None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:36.361807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-90473e68-989c-4c5b-a471-e0c65dc51a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:36.390333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:36.452438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 678/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 12:49:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:40.672384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb35374-9b7e-487f-8348-64cf338820cc None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:40.673045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb35374-9b7e-487f-8348-64cf338820cc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:40.673045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb35374-9b7e-487f-8348-64cf338820cc None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:40.674442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 674/1352] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 12:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:40.681120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe774f-6b92-4f44-9308-1791a7110e19 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:40.681613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe774f-6b92-4f44-9308-1791a7110e19 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:40.681752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe774f-6b92-4f44-9308-1791a7110e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:40.701882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7cfe774f-6b92-4f44-9308-1791a7110e19 None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:40.703382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7cfe774f-6b92-4f44-9308-1791a7110e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:40.712709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 679/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:41.022285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=72 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:42.354960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d704e-32d2-4444-8ccc-9c3f70d6a927 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:42.355592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d704e-32d2-4444-8ccc-9c3f70d6a927 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:42.355725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d704e-32d2-4444-8ccc-9c3f70d6a927 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:42.357159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 675/1354] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 12:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:42.362475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006ac9-0efc-4ff6-a70e-f4bf94832fe3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:42.362893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006ac9-0efc-4ff6-a70e-f4bf94832fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:42.363093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006ac9-0efc-4ff6-a70e-f4bf94832fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:42.383066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1a006ac9-0efc-4ff6-a70e-f4bf94832fe3 None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:42.384305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1a006ac9-0efc-4ff6-a70e-f4bf94832fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:42.393649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 680/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 12:49:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:46.056121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6d57-d766-499f-8b72-52d5963725df None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:46.056663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6d57-d766-499f-8b72-52d5963725df None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:46.056824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6d57-d766-499f-8b72-52d5963725df None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:46.058364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 676/1356] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:46.064345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0fee-9295-4d04-b83c-5f5fbbb8978c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:46.064831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0fee-9295-4d04-b83c-5f5fbbb8978c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:46.064931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0fee-9295-4d04-b83c-5f5fbbb8978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:46.093234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9ffc0fee-9295-4d04-b83c-5f5fbbb8978c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:46.094634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9ffc0fee-9295-4d04-b83c-5f5fbbb8978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:46.109198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 681/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:46.162179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9706e01-cbc3-43e8-afe4-248820b71e94 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:46.163268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9706e01-cbc3-43e8-afe4-248820b71e94 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:46.163784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9706e01-cbc3-43e8-afe4-248820b71e94 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:46.165881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 677/1358] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 17 12:49:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:46.176794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcddfac-ec45-49a0-9af0-587309a83eed None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:46.177353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcddfac-ec45-49a0-9af0-587309a83eed None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:46.177861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcddfac-ec45-49a0-9af0-587309a83eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:46.231423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4bcddfac-ec45-49a0-9af0-587309a83eed None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:46.232626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4bcddfac-ec45-49a0-9af0-587309a83eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:46.337387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 682/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 17 12:49:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:46.345357 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9706e01-cbc3-43e8-afe4-248820b71e94 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:46.369055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9706e01-cbc3-43e8-afe4-248820b71e94 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:46.374670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7bfb5-3756-4586-957a-77a3d6f3f836 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:46.375343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7bfb5-3756-4586-957a-77a3d6f3f836 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:46.375630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7bfb5-3756-4586-957a-77a3d6f3f836 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:46.375913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7bfb5-3756-4586-957a-77a3d6f3f836 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:46.385248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7bfb5-3756-4586-957a-77a3d6f3f836 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:46.386981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7bfb5-3756-4586-957a-77a3d6f3f836 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:46.398151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 678/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:48.726573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df99f2-2e45-4c42-8c18-09df204e6184 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:48.727181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df99f2-2e45-4c42-8c18-09df204e6184 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:48.727181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df99f2-2e45-4c42-8c18-09df204e6184 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:48.730152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 683/1361] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:48.734518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4714-9cdc-4490-b00a-bacb30e67425 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:48.735004 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4714-9cdc-4490-b00a-bacb30e67425 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:48.735105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4714-9cdc-4490-b00a-bacb30e67425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:48.755045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-196e4714-9cdc-4490-b00a-bacb30e67425 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:48.756429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-196e4714-9cdc-4490-b00a-bacb30e67425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:48.765003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 679/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:49:48.812810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df99f2-2e45-4c42-8c18-09df204e6184 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:48.828897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df99f2-2e45-4c42-8c18-09df204e6184 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:48.834935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197caa-d009-448f-976e-8fa8d935ae5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:48.835890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197caa-d009-448f-976e-8fa8d935ae5c service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:48.836359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197caa-d009-448f-976e-8fa8d935ae5c service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:48.836846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197caa-d009-448f-976e-8fa8d935ae5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:48.846551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197caa-d009-448f-976e-8fa8d935ae5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:48.848527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197caa-d009-448f-976e-8fa8d935ae5c service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:48.862641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 684/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:51.333654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e3c8-c6fc-448b-9452-22c04c158665 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:51.334221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e3c8-c6fc-448b-9452-22c04c158665 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:51.334221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e3c8-c6fc-448b-9452-22c04c158665 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:51.335563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 680/1364] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:51.341116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ee66a-3bec-49ac-b1de-d31e9adea684 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:51.341522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ee66a-3bec-49ac-b1de-d31e9adea684 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:51.341677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ee66a-3bec-49ac-b1de-d31e9adea684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:51.361445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a35ee66a-3bec-49ac-b1de-d31e9adea684 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:51.362696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a35ee66a-3bec-49ac-b1de-d31e9adea684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:51.371804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 685/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:51.417840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5713621-71fa-441c-8ee1-3caf8a9ea612 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:51.418122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5713621-71fa-441c-8ee1-3caf8a9ea612 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:51.418450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5713621-71fa-441c-8ee1-3caf8a9ea612 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:51.419848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 681/1366] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 17 12:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:51.425590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d58cd6-a984-4a03-9343-40d5762b549b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:51.425916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d58cd6-a984-4a03-9343-40d5762b549b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:51.426422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d58cd6-a984-4a03-9343-40d5762b549b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:51.447409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a1d58cd6-a984-4a03-9343-40d5762b549b None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:51.448781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a1d58cd6-a984-4a03-9343-40d5762b549b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:51.459866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 686/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 17 12:49:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:51.468335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5713621-71fa-441c-8ee1-3caf8a9ea612 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:51.486730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5713621-71fa-441c-8ee1-3caf8a9ea612 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:51.494362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab1658-381a-4935-9585-0c8ea5678b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:51.494595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab1658-381a-4935-9585-0c8ea5678b8d service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:51.494880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab1658-381a-4935-9585-0c8ea5678b8d service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:51.495158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab1658-381a-4935-9585-0c8ea5678b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:51.504195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab1658-381a-4935-9585-0c8ea5678b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:51.505848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab1658-381a-4935-9585-0c8ea5678b8d service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:51.515409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 682/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:49:53.815219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246146ff-1fa1-452e-abda-1265a429234c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:53.815768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246146ff-1fa1-452e-abda-1265a429234c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:53.815768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246146ff-1fa1-452e-abda-1265a429234c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:53.817055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 687/1369] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:53.823462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac4384-c010-40f0-9a37-0073c2bcb0e9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:53.823970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac4384-c010-40f0-9a37-0073c2bcb0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:53.823970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac4384-c010-40f0-9a37-0073c2bcb0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:53.843445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-26ac4384-c010-40f0-9a37-0073c2bcb0e9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:53.844649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-26ac4384-c010-40f0-9a37-0073c2bcb0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:53.853823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 683/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:53.900747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246146ff-1fa1-452e-abda-1265a429234c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:53.917277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246146ff-1fa1-452e-abda-1265a429234c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:53.924344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62143cba-31bf-4880-ba91-c3a18ee8d5a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:53.925420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62143cba-31bf-4880-ba91-c3a18ee8d5a6 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:53.925895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62143cba-31bf-4880-ba91-c3a18ee8d5a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:53.926351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62143cba-31bf-4880-ba91-c3a18ee8d5a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:53.936922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62143cba-31bf-4880-ba91-c3a18ee8d5a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:53.938577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62143cba-31bf-4880-ba91-c3a18ee8d5a6 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:53.951459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 688/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:54.303082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23652d-3cc7-4797-a35d-4eb2ada675a5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:54.303375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23652d-3cc7-4797-a35d-4eb2ada675a5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:54.303845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23652d-3cc7-4797-a35d-4eb2ada675a5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:54.305306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 684/1372] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:54.313829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a359e-6f0b-4d0b-bb64-de7d1d9803cf None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:54.314227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a359e-6f0b-4d0b-bb64-de7d1d9803cf None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:54.314567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a359e-6f0b-4d0b-bb64-de7d1d9803cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:54.334658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-569a359e-6f0b-4d0b-bb64-de7d1d9803cf None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:54.336278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-569a359e-6f0b-4d0b-bb64-de7d1d9803cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:54.345335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 689/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:54.684623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaafe31-d6f6-4416-a2b2-761ad6da3729 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:54.685041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaafe31-d6f6-4416-a2b2-761ad6da3729 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:54.685421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaafe31-d6f6-4416-a2b2-761ad6da3729 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:54.687017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 685/1374] 10.222.0.48 () {54 vars in 963 bytes} [Fri Jun 17 12:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:54.692855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32db9da-df7a-40f7-ae74-5fce3621857e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:54.693258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32db9da-df7a-40f7-ae74-5fce3621857e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:54.693631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32db9da-df7a-40f7-ae74-5fce3621857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:54.702052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:49:54.757648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f32db9da-df7a-40f7-ae74-5fce3621857e None None] MFA Rules not processed for user `68fc7c689f3645149d927663730bab5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:54.759329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f32db9da-df7a-40f7-ae74-5fce3621857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:54.829871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 690/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Jun 17 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:54.837790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaafe31-d6f6-4416-a2b2-761ad6da3729 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:54.852987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaafe31-d6f6-4416-a2b2-761ad6da3729 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:54.857203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce069-c6cb-4ddd-bbc0-dbda0d7d2a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:54.858150 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce069-c6cb-4ddd-bbc0-dbda0d7d2a64 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:54.858619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce069-c6cb-4ddd-bbc0-dbda0d7d2a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:54.859216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce069-c6cb-4ddd-bbc0-dbda0d7d2a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:54.871151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce069-c6cb-4ddd-bbc0-dbda0d7d2a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:54.872899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce069-c6cb-4ddd-bbc0-dbda0d7d2a64 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:54.884270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 686/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:56.336264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33482563-75fd-4643-998f-4dc63b707450 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:56.336862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33482563-75fd-4643-998f-4dc63b707450 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:56.336862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33482563-75fd-4643-998f-4dc63b707450 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:56.338230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 691/1377] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:49:56.344771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc67ee-4bd2-47d3-9d8c-a62774a6edd7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:56.345284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc67ee-4bd2-47d3-9d8c-a62774a6edd7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:56.345381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc67ee-4bd2-47d3-9d8c-a62774a6edd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:56.372556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2ddc67ee-4bd2-47d3-9d8c-a62774a6edd7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:56.373795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2ddc67ee-4bd2-47d3-9d8c-a62774a6edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:56.382904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 687/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:56.430112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33482563-75fd-4643-998f-4dc63b707450 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:56.447050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33482563-75fd-4643-998f-4dc63b707450 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:56.453189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9edcd2-8a3b-420a-a81c-b589a7a1c1e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:56.453849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9edcd2-8a3b-420a-a81c-b589a7a1c1e6 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:56.454176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9edcd2-8a3b-420a-a81c-b589a7a1c1e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:56.454441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9edcd2-8a3b-420a-a81c-b589a7a1c1e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:56.463862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9edcd2-8a3b-420a-a81c-b589a7a1c1e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:56.465685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9edcd2-8a3b-420a-a81c-b589a7a1c1e6 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:56.476908 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 692/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:49:58.755068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e40ef-42d8-489e-8bed-0df358d0db79 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:58.755576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e40ef-42d8-489e-8bed-0df358d0db79 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:58.755748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e40ef-42d8-489e-8bed-0df358d0db79 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:58.757681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 688/1380] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:49:58.763263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8598e1-3cb5-4af3-8b1b-14643bc3c806 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:58.763758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8598e1-3cb5-4af3-8b1b-14643bc3c806 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:58.763841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8598e1-3cb5-4af3-8b1b-14643bc3c806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:58.783945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8c8598e1-3cb5-4af3-8b1b-14643bc3c806 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:49:58.785152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8c8598e1-3cb5-4af3-8b1b-14643bc3c806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:49:58.793158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 693/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:49:58.838607 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e40ef-42d8-489e-8bed-0df358d0db79 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:49:58.853335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e40ef-42d8-489e-8bed-0df358d0db79 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:49:58.859079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ce211-ccc5-4a5e-86d6-9df39e99d564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:49:58.859712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ce211-ccc5-4a5e-86d6-9df39e99d564 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:49:58.859994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ce211-ccc5-4a5e-86d6-9df39e99d564 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:49:58.860571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ce211-ccc5-4a5e-86d6-9df39e99d564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:49:58.870652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ce211-ccc5-4a5e-86d6-9df39e99d564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:49:58.872258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ce211-ccc5-4a5e-86d6-9df39e99d564 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:49:58.884615 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 689/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:01.113776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655078b-9039-4c45-8be2-8d78583a19b2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:01.114601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655078b-9039-4c45-8be2-8d78583a19b2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:01.114902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655078b-9039-4c45-8be2-8d78583a19b2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:01.116339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 694/1383] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:01.122259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d69873-2c50-436c-8159-e350c1799cd7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:01.122767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d69873-2c50-436c-8159-e350c1799cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:01.122858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d69873-2c50-436c-8159-e350c1799cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:01.141692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-81d69873-2c50-436c-8159-e350c1799cd7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:01.142918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-81d69873-2c50-436c-8159-e350c1799cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:01.151121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 690/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:01.194936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655078b-9039-4c45-8be2-8d78583a19b2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:01.210542 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655078b-9039-4c45-8be2-8d78583a19b2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:01.216132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6145e-5325-4ef6-9458-9f89c4543bfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:01.216821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6145e-5325-4ef6-9458-9f89c4543bfc service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:01.217108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6145e-5325-4ef6-9458-9f89c4543bfc service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:01.217383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6145e-5325-4ef6-9458-9f89c4543bfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:01.226789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6145e-5325-4ef6-9458-9f89c4543bfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:01.228363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6145e-5325-4ef6-9458-9f89c4543bfc service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:01.239202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 695/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:03.459579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486fbcc-797b-49ae-9200-d6a0d7984408 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:03.460270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486fbcc-797b-49ae-9200-d6a0d7984408 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:03.460270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486fbcc-797b-49ae-9200-d6a0d7984408 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:03.461628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 691/1386] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:03.468849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b211d-7469-4ca3-8b89-c7a9f0e52938 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:03.469385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b211d-7469-4ca3-8b89-c7a9f0e52938 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:03.469566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b211d-7469-4ca3-8b89-c7a9f0e52938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:03.493299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-358b211d-7469-4ca3-8b89-c7a9f0e52938 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:03.494943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-358b211d-7469-4ca3-8b89-c7a9f0e52938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:03.506218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 696/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:03.557988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486fbcc-797b-49ae-9200-d6a0d7984408 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:03.576718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486fbcc-797b-49ae-9200-d6a0d7984408 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:03.584142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab2ac6-f53c-40e5-8a3b-2c54a577de66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:03.585092 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2ac6-f53c-40e5-8a3b-2c54a577de66 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:03.585486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2ac6-f53c-40e5-8a3b-2c54a577de66 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:03.585870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2ac6-f53c-40e5-8a3b-2c54a577de66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:03.599881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab2ac6-f53c-40e5-8a3b-2c54a577de66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:03.601682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab2ac6-f53c-40e5-8a3b-2c54a577de66 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:03.613003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 692/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:06.050895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38bc6c-9818-41b5-b3f5-869ac6d4707d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:06.051577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38bc6c-9818-41b5-b3f5-869ac6d4707d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:06.051577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38bc6c-9818-41b5-b3f5-869ac6d4707d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:06.052897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 697/1389] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:06.059233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928b41e-a18a-45a1-955c-d033eb20cd6a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:06.059729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928b41e-a18a-45a1-955c-d033eb20cd6a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:06.059912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928b41e-a18a-45a1-955c-d033eb20cd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:06.083307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2928b41e-a18a-45a1-955c-d033eb20cd6a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:06.084872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2928b41e-a18a-45a1-955c-d033eb20cd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:06.094862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 693/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:06.147791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38bc6c-9818-41b5-b3f5-869ac6d4707d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:06.164177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38bc6c-9818-41b5-b3f5-869ac6d4707d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:06.171017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a722-4c5e-45d1-9059-afa2e748e0b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:06.171730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a722-4c5e-45d1-9059-afa2e748e0b0 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:06.172058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a722-4c5e-45d1-9059-afa2e748e0b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:06.172333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a722-4c5e-45d1-9059-afa2e748e0b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:06.182308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9a722-4c5e-45d1-9059-afa2e748e0b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:06.183982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9a722-4c5e-45d1-9059-afa2e748e0b0 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:06.194165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 698/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:50:08.501140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc7cf9-4031-4230-bb80-d5c286e1d604 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:08.501714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc7cf9-4031-4230-bb80-d5c286e1d604 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:08.501808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc7cf9-4031-4230-bb80-d5c286e1d604 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:08.503257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 694/1392] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:08.509287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fdb2b-2ad7-42cf-a784-868985ebca93 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:08.509804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fdb2b-2ad7-42cf-a784-868985ebca93 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:08.509804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fdb2b-2ad7-42cf-a784-868985ebca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:08.529224 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-152fdb2b-2ad7-42cf-a784-868985ebca93 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:08.530465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-152fdb2b-2ad7-42cf-a784-868985ebca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:08.539178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 699/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:08.584396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc7cf9-4031-4230-bb80-d5c286e1d604 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:08.600034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc7cf9-4031-4230-bb80-d5c286e1d604 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:08.605830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275cae2-a58d-4317-8c45-493501b470bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:08.606521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275cae2-a58d-4317-8c45-493501b470bf service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:08.606809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275cae2-a58d-4317-8c45-493501b470bf service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:08.607080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275cae2-a58d-4317-8c45-493501b470bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:08.616526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275cae2-a58d-4317-8c45-493501b470bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:08.618584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275cae2-a58d-4317-8c45-493501b470bf service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:08.629265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 695/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:10.389364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b246d-54d0-4e88-bad5-23add2cf38f9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:10.390250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b246d-54d0-4e88-bad5-23add2cf38f9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:10.390250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b246d-54d0-4e88-bad5-23add2cf38f9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:10.391340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 700/1395] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:10.397520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd2458-9b3f-484f-b7e1-f67a66df1272 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:10.398030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd2458-9b3f-484f-b7e1-f67a66df1272 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:10.398030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd2458-9b3f-484f-b7e1-f67a66df1272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:10.417024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-86fd2458-9b3f-484f-b7e1-f67a66df1272 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:10.418255 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-86fd2458-9b3f-484f-b7e1-f67a66df1272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:10.426865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 696/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:10.482714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6235b-c225-43ee-ae82-547b71702ec7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:10.482994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6235b-c225-43ee-ae82-547b71702ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:10.483287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6235b-c225-43ee-ae82-547b71702ec7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:10.484635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 701/1397] 10.222.0.48 () {54 vars in 962 bytes} [Fri Jun 17 12:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:10.490126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8fdad-345d-417f-ad29-ee880cb19967 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:10.490513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8fdad-345d-417f-ad29-ee880cb19967 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:10.490925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8fdad-345d-417f-ad29-ee880cb19967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:10.542733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a0a8fdad-345d-417f-ad29-ee880cb19967 None None] MFA Rules not processed for user `984780a6a8df405dbbb2ba4c46dd841c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:10.543843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a0a8fdad-345d-417f-ad29-ee880cb19967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:10.605495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 697/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Jun 17 12:50:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:10.613567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6235b-c225-43ee-ae82-547b71702ec7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:10.625254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6235b-c225-43ee-ae82-547b71702ec7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:10.628910 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce26105-a72f-40d1-b972-8f5b0b37b1b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984780a6a8df405dbbb2ba4c46dd841c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:10.629567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce26105-a72f-40d1-b972-8f5b0b37b1b8 service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:10.629844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce26105-a72f-40d1-b972-8f5b0b37b1b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:10.630310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce26105-a72f-40d1-b972-8f5b0b37b1b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:10.640080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce26105-a72f-40d1-b972-8f5b0b37b1b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:10.641563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce26105-a72f-40d1-b972-8f5b0b37b1b8 service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:10.651960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 702/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:10.798401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd5a3e-7709-43a3-8fe6-98a19a9c9294 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:10.798629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd5a3e-7709-43a3-8fe6-98a19a9c9294 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:10.798870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd5a3e-7709-43a3-8fe6-98a19a9c9294 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:10.800470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 698/1400] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:10.805856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f576-c422-4ab0-ac1e-22baf70ab779 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:10.806183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f576-c422-4ab0-ac1e-22baf70ab779 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:10.806463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f576-c422-4ab0-ac1e-22baf70ab779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:10.824687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0dd3f576-c422-4ab0-ac1e-22baf70ab779 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:10.825887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0dd3f576-c422-4ab0-ac1e-22baf70ab779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:10.835020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 703/1401] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:10.881557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd5a3e-7709-43a3-8fe6-98a19a9c9294 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:10.901388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd5a3e-7709-43a3-8fe6-98a19a9c9294 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:10.907976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5259d-4434-4edd-8794-6b449eb3b9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:10.908642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5259d-4434-4edd-8794-6b449eb3b9a8 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:10.908952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5259d-4434-4edd-8794-6b449eb3b9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:10.909239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5259d-4434-4edd-8794-6b449eb3b9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:10.918639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5259d-4434-4edd-8794-6b449eb3b9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:10.920258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5259d-4434-4edd-8794-6b449eb3b9a8 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:10.930963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 699/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:11.409237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64b32f-4604-49f9-a06e-48da789f0fa5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:11.409723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64b32f-4604-49f9-a06e-48da789f0fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:11.409803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64b32f-4604-49f9-a06e-48da789f0fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:11.464634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-eb64b32f-4604-49f9-a06e-48da789f0fa5 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:11.465862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-eb64b32f-4604-49f9-a06e-48da789f0fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:11.502386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:50:11.537158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 704/1403] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:11.582803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6da0-e678-4c26-b9f7-54b9d33eeb30 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:11.583278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6da0-e678-4c26-b9f7-54b9d33eeb30 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:11.583581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6da0-e678-4c26-b9f7-54b9d33eeb30 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:11.585070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 700/1404] 10.222.0.48 () {54 vars in 942 bytes} [Fri Jun 17 12:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:11.591710 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f567e-5bb7-480f-8f75-be5255385db4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:11.592004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f567e-5bb7-480f-8f75-be5255385db4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:11.592282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f567e-5bb7-480f-8f75-be5255385db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:11.643734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9a1f567e-5bb7-480f-8f75-be5255385db4 None None] MFA Rules not processed for user `ed5fff4bed294d16a0e1d5fec4991c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:11.644927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9a1f567e-5bb7-480f-8f75-be5255385db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:11.721686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 705/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Fri Jun 17 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:11.731641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6da0-e678-4c26-b9f7-54b9d33eeb30 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:11.739572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:50:11.746799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6da0-e678-4c26-b9f7-54b9d33eeb30 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:11.752006 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7b8b0-e3a0-401a-95ba-d63a7a051c69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:11.752798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7b8b0-e3a0-401a-95ba-d63a7a051c69 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:11.753100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7b8b0-e3a0-401a-95ba-d63a7a051c69 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:11.753444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7b8b0-e3a0-401a-95ba-d63a7a051c69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:11.762587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7b8b0-e3a0-401a-95ba-d63a7a051c69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:11.764211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7b8b0-e3a0-401a-95ba-d63a7a051c69 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:11.772782 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 701/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 12:50:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 12:50:13.116703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711114d9-1826-43ad-8be6-6db1ec808d70 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:13.117344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711114d9-1826-43ad-8be6-6db1ec808d70 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:13.117344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711114d9-1826-43ad-8be6-6db1ec808d70 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:13.119026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 706/1407] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:13.124315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2165e5-7347-44d8-92d5-af0cc5b49219 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:13.124797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2165e5-7347-44d8-92d5-af0cc5b49219 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:13.125095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2165e5-7347-44d8-92d5-af0cc5b49219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:13.152036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-df2165e5-7347-44d8-92d5-af0cc5b49219 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:13.153314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-df2165e5-7347-44d8-92d5-af0cc5b49219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:13.161466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 702/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:13.204952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711114d9-1826-43ad-8be6-6db1ec808d70 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:13.221495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711114d9-1826-43ad-8be6-6db1ec808d70 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:13.228644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146ac2c-c97e-4ddd-a260-bc561d346232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:13.229304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146ac2c-c97e-4ddd-a260-bc561d346232 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:13.229590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146ac2c-c97e-4ddd-a260-bc561d346232 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:13.229876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146ac2c-c97e-4ddd-a260-bc561d346232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:13.239370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146ac2c-c97e-4ddd-a260-bc561d346232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:13.240884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146ac2c-c97e-4ddd-a260-bc561d346232 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:13.252929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 707/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:23.146906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:50:23.248532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=62 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:50:34.057597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176895ae-9d20-4bd5-be9a-58cc5b6a4f53 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:34.058231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176895ae-9d20-4bd5-be9a-58cc5b6a4f53 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:34.058231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176895ae-9d20-4bd5-be9a-58cc5b6a4f53 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:34.059591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 703/1410] 10.222.0.48 () {54 vars in 918 bytes} [Fri Jun 17 12:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:34.064839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10cc0-45d6-4f40-8014-bc456c9190ac None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:34.065320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10cc0-45d6-4f40-8014-bc456c9190ac None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:34.065421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10cc0-45d6-4f40-8014-bc456c9190ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:34.086020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a8e10cc0-45d6-4f40-8014-bc456c9190ac None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:34.087263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a8e10cc0-45d6-4f40-8014-bc456c9190ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:34.096798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 708/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Jun 17 12:50:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:34.116019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80e5c-76ed-4628-9165-a30d3fd9c854 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:34.116330 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80e5c-76ed-4628-9165-a30d3fd9c854 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:34.116629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c80e5c-76ed-4628-9165-a30d3fd9c854 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:34.118755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 704/1412] 10.222.0.48 () {54 vars in 918 bytes} [Fri Jun 17 12:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:34.124921 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255b342-2189-477c-9109-0761196e638b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:34.125212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255b342-2189-477c-9109-0761196e638b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:34.125487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255b342-2189-477c-9109-0761196e638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:34.146580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e255b342-2189-477c-9109-0761196e638b None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:34.147942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e255b342-2189-477c-9109-0761196e638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:34.157499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 709/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Jun 17 12:50:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:36.784896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71e74-b5dc-4c74-8b1c-d353724bd62f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:36.785505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71e74-b5dc-4c74-8b1c-d353724bd62f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:36.785505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71e74-b5dc-4c74-8b1c-d353724bd62f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:36.786873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:36.792288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde44ee-6bbd-4761-8307-43fc56bb22a6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:36.792769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde44ee-6bbd-4761-8307-43fc56bb22a6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:36.792872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde44ee-6bbd-4761-8307-43fc56bb22a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:36.811867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3cde44ee-6bbd-4761-8307-43fc56bb22a6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:36.813084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3cde44ee-6bbd-4761-8307-43fc56bb22a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:36.823390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:36.867213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e71e74-b5dc-4c74-8b1c-d353724bd62f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:36.884697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e71e74-b5dc-4c74-8b1c-d353724bd62f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:36.891165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6ac4d-d5ea-4ec5-84ea-50334d5c3f25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:36.891827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ac4d-d5ea-4ec5-84ea-50334d5c3f25 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:36.892112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ac4d-d5ea-4ec5-84ea-50334d5c3f25 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:36.892382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ac4d-d5ea-4ec5-84ea-50334d5c3f25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:36.901890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6ac4d-d5ea-4ec5-84ea-50334d5c3f25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:36.903590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6ac4d-d5ea-4ec5-84ea-50334d5c3f25 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:36.913788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 706/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:37.910590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617705-f959-4512-a21d-ecddae092d56 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:37.911198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617705-f959-4512-a21d-ecddae092d56 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:37.911198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617705-f959-4512-a21d-ecddae092d56 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:37.913617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:50:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:37.919271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36a53f-44cb-4c14-90ee-7f15b9bfb26d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:37.919746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36a53f-44cb-4c14-90ee-7f15b9bfb26d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:37.919746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36a53f-44cb-4c14-90ee-7f15b9bfb26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:37.939660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9b36a53f-44cb-4c14-90ee-7f15b9bfb26d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:37.940923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9b36a53f-44cb-4c14-90ee-7f15b9bfb26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:37.949803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:38.109332 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87617705-f959-4512-a21d-ecddae092d56 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:38.125542 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87617705-f959-4512-a21d-ecddae092d56 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:38.132433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e7995-9dd9-49a0-8eda-5c34797dde4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:38.133388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e7995-9dd9-49a0-8eda-5c34797dde4f service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:38.133955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e7995-9dd9-49a0-8eda-5c34797dde4f service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:38.134369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e7995-9dd9-49a0-8eda-5c34797dde4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:38.148191 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e7995-9dd9-49a0-8eda-5c34797dde4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:38.149887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e7995-9dd9-49a0-8eda-5c34797dde4f service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:38.160376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 712/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:39.110808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda59-1ad8-4a29-ba43-02919ef51a45 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:39.111425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda59-1ad8-4a29-ba43-02919ef51a45 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:39.111425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda59-1ad8-4a29-ba43-02919ef51a45 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:39.113440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:50:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:39.119854 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef20e-b6a6-4fc8-b357-8e50d7d24432 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:39.120305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef20e-b6a6-4fc8-b357-8e50d7d24432 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:39.120417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef20e-b6a6-4fc8-b357-8e50d7d24432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:39.143800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-489ef20e-b6a6-4fc8-b357-8e50d7d24432 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:39.145001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-489ef20e-b6a6-4fc8-b357-8e50d7d24432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:39.154022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:39.320848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebda59-1ad8-4a29-ba43-02919ef51a45 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:39.344481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebda59-1ad8-4a29-ba43-02919ef51a45 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:39.353036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6b480-f676-47b4-9608-fb4cc8344646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:39.353696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6b480-f676-47b4-9608-fb4cc8344646 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:39.353979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6b480-f676-47b4-9608-fb4cc8344646 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:39.354314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6b480-f676-47b4-9608-fb4cc8344646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:39.365255 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6b480-f676-47b4-9608-fb4cc8344646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:39.368763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6b480-f676-47b4-9608-fb4cc8344646 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:39.384156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 709/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:40.295636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdc0b-0355-438d-b91f-91e5b6497c1f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:40.296257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdc0b-0355-438d-b91f-91e5b6497c1f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:40.296257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdc0b-0355-438d-b91f-91e5b6497c1f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:40.297546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:40.303383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9791ea9-ce6d-4aba-9efc-a05f9c981484 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:40.303891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9791ea9-ce6d-4aba-9efc-a05f9c981484 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:40.304005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9791ea9-ce6d-4aba-9efc-a05f9c981484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:40.329437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b9791ea9-ce6d-4aba-9efc-a05f9c981484 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:40.331277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b9791ea9-ce6d-4aba-9efc-a05f9c981484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:40.341173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:40.496492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bdc0b-0355-438d-b91f-91e5b6497c1f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:40.513841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bdc0b-0355-438d-b91f-91e5b6497c1f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:40.521964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d894d75-9b03-41fb-95fb-2381d73982ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:40.522655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d894d75-9b03-41fb-95fb-2381d73982ac service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:40.522941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d894d75-9b03-41fb-95fb-2381d73982ac service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:40.523223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d894d75-9b03-41fb-95fb-2381d73982ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:40.532366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d894d75-9b03-41fb-95fb-2381d73982ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:40.533977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d894d75-9b03-41fb-95fb-2381d73982ac service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:40.544125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 715/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:41.476358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3341d-17f6-4531-be9f-40a7e1976cc0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:41.477248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3341d-17f6-4531-be9f-40a7e1976cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:41.477248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3341d-17f6-4531-be9f-40a7e1976cc0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:41.479450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:50:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:41.484675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679e0e7-60af-4f64-9434-84d130765802 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:41.485130 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679e0e7-60af-4f64-9434-84d130765802 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:41.485227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679e0e7-60af-4f64-9434-84d130765802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:41.509872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3679e0e7-60af-4f64-9434-84d130765802 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:41.511142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3679e0e7-60af-4f64-9434-84d130765802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:41.520331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:41.671591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3341d-17f6-4531-be9f-40a7e1976cc0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:41.694834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3341d-17f6-4531-be9f-40a7e1976cc0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:41.708147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddcf09-fb7c-42ef-b498-d57349e33d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:41.709187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddcf09-fb7c-42ef-b498-d57349e33d4f service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:41.710124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddcf09-fb7c-42ef-b498-d57349e33d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:41.710124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddcf09-fb7c-42ef-b498-d57349e33d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:41.719127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddcf09-fb7c-42ef-b498-d57349e33d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:41.720743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddcf09-fb7c-42ef-b498-d57349e33d4f service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:41.731103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 712/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:42.588330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dcc79-a018-41d9-866b-b1b2c50e9d79 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:42.589246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dcc79-a018-41d9-866b-b1b2c50e9d79 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:42.589246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dcc79-a018-41d9-866b-b1b2c50e9d79 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:42.591322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:50:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:42.600418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c32d-c9e4-45d0-84d1-ce92af2440ac None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:42.601121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c32d-c9e4-45d0-84d1-ce92af2440ac None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:42.601531 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33c32d-c9e4-45d0-84d1-ce92af2440ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:42.631390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fc33c32d-c9e4-45d0-84d1-ce92af2440ac None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:42.633070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fc33c32d-c9e4-45d0-84d1-ce92af2440ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:42.644744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:42.808047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dcc79-a018-41d9-866b-b1b2c50e9d79 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:42.824884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dcc79-a018-41d9-866b-b1b2c50e9d79 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:42.831944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ce04a-91c5-41c2-9fdc-df24b18c2d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:42.832614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ce04a-91c5-41c2-9fdc-df24b18c2d3a service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:42.832899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ce04a-91c5-41c2-9fdc-df24b18c2d3a service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:42.833173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ce04a-91c5-41c2-9fdc-df24b18c2d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:42.842829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ce04a-91c5-41c2-9fdc-df24b18c2d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:42.844414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ce04a-91c5-41c2-9fdc-df24b18c2d3a service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:42.855755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 718/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:43.727788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849416-76d7-4f07-b0db-e964e746f00b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:43.728383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849416-76d7-4f07-b0db-e964e746f00b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:43.728383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849416-76d7-4f07-b0db-e964e746f00b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:43.729823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:43.737625 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec911a-2b86-4c59-8234-7c884bd95fa4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:43.738417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec911a-2b86-4c59-8234-7c884bd95fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:43.738609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec911a-2b86-4c59-8234-7c884bd95fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:43.763940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f6ec911a-2b86-4c59-8234-7c884bd95fa4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:43.765147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f6ec911a-2b86-4c59-8234-7c884bd95fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:43.773508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:43.941402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44849416-76d7-4f07-b0db-e964e746f00b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:43.961619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44849416-76d7-4f07-b0db-e964e746f00b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:43.970425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71218b-4fbe-48a9-b93b-f8fcb5ab5a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:43.971222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71218b-4fbe-48a9-b93b-f8fcb5ab5a90 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:43.971612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71218b-4fbe-48a9-b93b-f8fcb5ab5a90 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:43.972040 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71218b-4fbe-48a9-b93b-f8fcb5ab5a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:43.984769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71218b-4fbe-48a9-b93b-f8fcb5ab5a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:43.987780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71218b-4fbe-48a9-b93b-f8fcb5ab5a90 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:43.999350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 715/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:50:44.950546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c60fc-7a6c-4a68-b368-19b0f63e5e0e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:44.951144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c60fc-7a6c-4a68-b368-19b0f63e5e0e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:44.951144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c60fc-7a6c-4a68-b368-19b0f63e5e0e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:44.952480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:44.958582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1af68-4e3b-41f2-9592-ec096875420a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:44.959636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1af68-4e3b-41f2-9592-ec096875420a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:44.959924 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1af68-4e3b-41f2-9592-ec096875420a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:44.979121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c1c1af68-4e3b-41f2-9592-ec096875420a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:44.980337 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c1c1af68-4e3b-41f2-9592-ec096875420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:44.995096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:45.149869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c60fc-7a6c-4a68-b368-19b0f63e5e0e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:45.165163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c60fc-7a6c-4a68-b368-19b0f63e5e0e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:45.171814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbeb27-3f17-458a-8d52-e431110ad603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:45.172475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbeb27-3f17-458a-8d52-e431110ad603 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:45.172755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbeb27-3f17-458a-8d52-e431110ad603 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:45.173038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbeb27-3f17-458a-8d52-e431110ad603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:45.183371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbeb27-3f17-458a-8d52-e431110ad603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:45.185016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbeb27-3f17-458a-8d52-e431110ad603 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:45.197634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 721/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:50:46.055915 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31ecf1-9849-4b82-a20a-17d6d8c2c9a2 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:46.056850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31ecf1-9849-4b82-a20a-17d6d8c2c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:46.056850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31ecf1-9849-4b82-a20a-17d6d8c2c9a2 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:46.059144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:50:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:46.067724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da364-cf70-4ae1-abab-649c5c254a0b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:46.068531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da364-cf70-4ae1-abab-649c5c254a0b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:46.068531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da364-cf70-4ae1-abab-649c5c254a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:46.097412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-224da364-cf70-4ae1-abab-649c5c254a0b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:46.098785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-224da364-cf70-4ae1-abab-649c5c254a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:46.108330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:46.268046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31ecf1-9849-4b82-a20a-17d6d8c2c9a2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:46.284418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31ecf1-9849-4b82-a20a-17d6d8c2c9a2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:46.290394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a0d4c-5314-47d4-8c8b-9cf1dc735c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:46.291048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a0d4c-5314-47d4-8c8b-9cf1dc735c04 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:46.291339 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a0d4c-5314-47d4-8c8b-9cf1dc735c04 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:46.291615 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a0d4c-5314-47d4-8c8b-9cf1dc735c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:46.300084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a0d4c-5314-47d4-8c8b-9cf1dc735c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:46.301689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a0d4c-5314-47d4-8c8b-9cf1dc735c04 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:46.312180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 718/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:48.309531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e1272-8385-4e25-854c-84d7dac3a825 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:48.310195 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e1272-8385-4e25-854c-84d7dac3a825 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:48.310195 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e1272-8385-4e25-854c-84d7dac3a825 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:48.311504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:48.317956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ed9c9-5f06-4b1a-af77-93a2d2b3c24b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:48.318629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ed9c9-5f06-4b1a-af77-93a2d2b3c24b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:48.318809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ed9c9-5f06-4b1a-af77-93a2d2b3c24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:48.341365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e38ed9c9-5f06-4b1a-af77-93a2d2b3c24b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:48.342592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e38ed9c9-5f06-4b1a-af77-93a2d2b3c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:48.351444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:48.403856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e1272-8385-4e25-854c-84d7dac3a825 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:48.420720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e1272-8385-4e25-854c-84d7dac3a825 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:48.425151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899ffb9-56f4-4944-8859-8c9594c332e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:48.425833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899ffb9-56f4-4944-8859-8c9594c332e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:48.426142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899ffb9-56f4-4944-8859-8c9594c332e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:48.426434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899ffb9-56f4-4944-8859-8c9594c332e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:48.439904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899ffb9-56f4-4944-8859-8c9594c332e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:48.441388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899ffb9-56f4-4944-8859-8c9594c332e7 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:48.451764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 724/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:50.746579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add90d75-c8ab-41b6-a94e-50b2ba9e2c27 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:50.747202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add90d75-c8ab-41b6-a94e-50b2ba9e2c27 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:50.747202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add90d75-c8ab-41b6-a94e-50b2ba9e2c27 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:50.748544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:50.754031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc090-b7f8-466d-a1c5-6046e657ebab None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:50.754541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc090-b7f8-466d-a1c5-6046e657ebab None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:50.754776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc090-b7f8-466d-a1c5-6046e657ebab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:50.773446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-31afc090-b7f8-466d-a1c5-6046e657ebab None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:50.774695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-31afc090-b7f8-466d-a1c5-6046e657ebab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:50.783181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:50.823887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add90d75-c8ab-41b6-a94e-50b2ba9e2c27 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:50.825909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-add90d75-c8ab-41b6-a94e-50b2ba9e2c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:50.841203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add90d75-c8ab-41b6-a94e-50b2ba9e2c27 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:50.846018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e835140-dceb-4bf1-9f41-8911dd8231e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:50.846719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835140-dceb-4bf1-9f41-8911dd8231e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:50.847009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835140-dceb-4bf1-9f41-8911dd8231e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:50.847290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e835140-dceb-4bf1-9f41-8911dd8231e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:50.858191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e835140-dceb-4bf1-9f41-8911dd8231e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:50.859963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e835140-dceb-4bf1-9f41-8911dd8231e7 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:50.872476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 721/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:53.348838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979fc1-0774-4727-bf5b-47c080387d21 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:53.349479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979fc1-0774-4727-bf5b-47c080387d21 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:53.349479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979fc1-0774-4727-bf5b-47c080387d21 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:53.350953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:53.356666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1115-85ca-4b04-914f-f364dd6101ef None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:53.357272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1115-85ca-4b04-914f-f364dd6101ef None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:53.357272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1115-85ca-4b04-914f-f364dd6101ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:53.376762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4bfd1115-85ca-4b04-914f-f364dd6101ef None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:53.377968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4bfd1115-85ca-4b04-914f-f364dd6101ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:53.397303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:50:53.437191 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d979fc1-0774-4727-bf5b-47c080387d21 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:53.450679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d979fc1-0774-4727-bf5b-47c080387d21 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:53.455207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a0c1-b515-4c70-8a7e-4a10c87c1216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:53.455883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a0c1-b515-4c70-8a7e-4a10c87c1216 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:53.456170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a0c1-b515-4c70-8a7e-4a10c87c1216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:53.456546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a0c1-b515-4c70-8a7e-4a10c87c1216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:53.467083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a0c1-b515-4c70-8a7e-4a10c87c1216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:53.468579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a0c1-b515-4c70-8a7e-4a10c87c1216 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:53.479163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 727/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:55.791838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24396228-fa94-47eb-b18d-687cc014612e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:55.792454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24396228-fa94-47eb-b18d-687cc014612e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:55.792454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24396228-fa94-47eb-b18d-687cc014612e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:55.793766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:55.799447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554145e-4967-4a99-9f3f-46020d7c6f2a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:55.799923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554145e-4967-4a99-9f3f-46020d7c6f2a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:55.800048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554145e-4967-4a99-9f3f-46020d7c6f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:55.819609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c554145e-4967-4a99-9f3f-46020d7c6f2a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:55.820842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c554145e-4967-4a99-9f3f-46020d7c6f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:55.830232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:55.868681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24396228-fa94-47eb-b18d-687cc014612e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:55.881427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24396228-fa94-47eb-b18d-687cc014612e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:55.885351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60243c-c3a6-4666-8120-e1a93c300007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:55.886012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60243c-c3a6-4666-8120-e1a93c300007 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:55.886327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60243c-c3a6-4666-8120-e1a93c300007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:55.886604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60243c-c3a6-4666-8120-e1a93c300007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:55.896860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60243c-c3a6-4666-8120-e1a93c300007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:55.897960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60243c-c3a6-4666-8120-e1a93c300007 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:55.907932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 724/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:50:58.273638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567be3-c295-412a-ab68-05f706758773 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:58.274426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567be3-c295-412a-ab68-05f706758773 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:58.274426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567be3-c295-412a-ab68-05f706758773 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:58.275864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:50:58.282392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0118e-2ae5-4d9e-84cb-d69ca19bfe3f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:58.283113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0118e-2ae5-4d9e-84cb-d69ca19bfe3f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:58.283261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0118e-2ae5-4d9e-84cb-d69ca19bfe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:58.306333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-65f0118e-2ae5-4d9e-84cb-d69ca19bfe3f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:50:58.307602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-65f0118e-2ae5-4d9e-84cb-d69ca19bfe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:50:58.317074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:50:58.358022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0567be3-c295-412a-ab68-05f706758773 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:50:58.370669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0567be3-c295-412a-ab68-05f706758773 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:50:58.374753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe965b-20d8-4b4f-9692-e352bf111ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:50:58.375410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe965b-20d8-4b4f-9692-e352bf111ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:50:58.375675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe965b-20d8-4b4f-9692-e352bf111ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:50:58.375955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe965b-20d8-4b4f-9692-e352bf111ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:50:58.388607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe965b-20d8-4b4f-9692-e352bf111ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:50:58.390294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe965b-20d8-4b4f-9692-e352bf111ba5 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:50:58.401669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 730/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:00.604663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2093f50-57b3-42b0-885b-a8af7e4b2ee9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:00.605234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2093f50-57b3-42b0-885b-a8af7e4b2ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:00.605234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2093f50-57b3-42b0-885b-a8af7e4b2ee9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:00.606572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:00.612115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1746ac5-72cc-448c-b0ca-eb3732260a6d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:00.612592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1746ac5-72cc-448c-b0ca-eb3732260a6d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:00.612706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1746ac5-72cc-448c-b0ca-eb3732260a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:00.631844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a1746ac5-72cc-448c-b0ca-eb3732260a6d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:00.633250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a1746ac5-72cc-448c-b0ca-eb3732260a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:00.642004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:00.681124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2093f50-57b3-42b0-885b-a8af7e4b2ee9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:00.692618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2093f50-57b3-42b0-885b-a8af7e4b2ee9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:00.696747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9f164-3a1c-47e0-8cf7-b2eb7f0190f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:00.697424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f164-3a1c-47e0-8cf7-b2eb7f0190f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:00.697708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f164-3a1c-47e0-8cf7-b2eb7f0190f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:00.697983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f164-3a1c-47e0-8cf7-b2eb7f0190f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:00.707352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9f164-3a1c-47e0-8cf7-b2eb7f0190f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:00.708930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9f164-3a1c-47e0-8cf7-b2eb7f0190f5 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:00.719095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 727/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:02.991216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12a95-da26-470f-8674-23d63e399ec7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:02.991836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12a95-da26-470f-8674-23d63e399ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:02.991836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12a95-da26-470f-8674-23d63e399ec7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:02.993171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:02.999423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baa8ab-8ad5-4f6d-bf31-1fddd20b7ad9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:02.999884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baa8ab-8ad5-4f6d-bf31-1fddd20b7ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:02.999985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baa8ab-8ad5-4f6d-bf31-1fddd20b7ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:03.019472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f6baa8ab-8ad5-4f6d-bf31-1fddd20b7ad9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:03.020732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f6baa8ab-8ad5-4f6d-bf31-1fddd20b7ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:03.030213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:03.068307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12a95-da26-470f-8674-23d63e399ec7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:03.080152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12a95-da26-470f-8674-23d63e399ec7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:03.084332 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aadea-bf21-4065-9859-65f27cdcf764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:03.084855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aadea-bf21-4065-9859-65f27cdcf764 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:03.085145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aadea-bf21-4065-9859-65f27cdcf764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:03.085426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aadea-bf21-4065-9859-65f27cdcf764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:03.095079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aadea-bf21-4065-9859-65f27cdcf764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:03.096557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aadea-bf21-4065-9859-65f27cdcf764 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:03.106478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 733/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:05.309320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8599249-7c19-4969-a618-8fad86b93510 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:05.309916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8599249-7c19-4969-a618-8fad86b93510 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:05.309916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8599249-7c19-4969-a618-8fad86b93510 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:05.311370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:05.318256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7432f-cd80-4c92-a9f0-f4e21f714ad3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:05.318861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7432f-cd80-4c92-a9f0-f4e21f714ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:05.319081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7432f-cd80-4c92-a9f0-f4e21f714ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:05.329674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=79 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:05.343499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7dc7432f-cd80-4c92-a9f0-f4e21f714ad3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:05.344727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7dc7432f-cd80-4c92-a9f0-f4e21f714ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:05.354985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:05.395180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8599249-7c19-4969-a618-8fad86b93510 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:05.404789 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=73 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:05.415262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8599249-7c19-4969-a618-8fad86b93510 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:05.419771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b9d76-3bd6-48e4-8982-da7397d697f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:05.420429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b9d76-3bd6-48e4-8982-da7397d697f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:05.420715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b9d76-3bd6-48e4-8982-da7397d697f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:05.420992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b9d76-3bd6-48e4-8982-da7397d697f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:05.430463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b9d76-3bd6-48e4-8982-da7397d697f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:05.431918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b9d76-3bd6-48e4-8982-da7397d697f1 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:05.443769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 730/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:07.606541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece08b4-9fca-423d-b8bc-1d9356c8dab0 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:07.607402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece08b4-9fca-423d-b8bc-1d9356c8dab0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:07.607402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece08b4-9fca-423d-b8bc-1d9356c8dab0 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:07.609570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:51:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:07.619252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57885-5f20-4d0e-8857-2982b228eb83 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:07.619955 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57885-5f20-4d0e-8857-2982b228eb83 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:07.620156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57885-5f20-4d0e-8857-2982b228eb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:07.646599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dfa57885-5f20-4d0e-8857-2982b228eb83 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:07.647970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dfa57885-5f20-4d0e-8857-2982b228eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:07.659516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:07.698464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece08b4-9fca-423d-b8bc-1d9356c8dab0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:07.711169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece08b4-9fca-423d-b8bc-1d9356c8dab0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:07.715494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60cbda-78b5-4a16-bc1f-507d35956e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:07.716148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60cbda-78b5-4a16-bc1f-507d35956e1c service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:07.716424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60cbda-78b5-4a16-bc1f-507d35956e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:07.716703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60cbda-78b5-4a16-bc1f-507d35956e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:07.727348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60cbda-78b5-4a16-bc1f-507d35956e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:07.728842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60cbda-78b5-4a16-bc1f-507d35956e1c service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:07.738347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 736/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:09.885588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41803bd-261d-4a59-acfa-198ad16acac0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:09.886548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41803bd-261d-4a59-acfa-198ad16acac0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:09.886548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41803bd-261d-4a59-acfa-198ad16acac0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:09.888802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:51:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:09.895779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e491-fc55-440d-b36e-6a07bca63b81 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:09.896575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e491-fc55-440d-b36e-6a07bca63b81 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:09.896705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e491-fc55-440d-b36e-6a07bca63b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:09.921657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ed76e491-fc55-440d-b36e-6a07bca63b81 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:09.922898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ed76e491-fc55-440d-b36e-6a07bca63b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:09.932517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:09.972363 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41803bd-261d-4a59-acfa-198ad16acac0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:09.987226 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41803bd-261d-4a59-acfa-198ad16acac0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:09.995325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3e97b-d07f-4c1c-b381-26662b4d6074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:09.996100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e97b-d07f-4c1c-b381-26662b4d6074 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:09.996465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e97b-d07f-4c1c-b381-26662b4d6074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:09.996870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e97b-d07f-4c1c-b381-26662b4d6074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:10.010812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3e97b-d07f-4c1c-b381-26662b4d6074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:10.012330 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3e97b-d07f-4c1c-b381-26662b4d6074 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:10.024661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 733/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:19.916207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=11 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:20.017972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=14 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:30.065057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b7a30-3884-4b94-a45a-6da7f6fdd8b2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:30.065913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b7a30-3884-4b94-a45a-6da7f6fdd8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:30.065913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b7a30-3884-4b94-a45a-6da7f6fdd8b2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:30.068172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 738/1471] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:51:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:30.073789 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8920d-aa00-4ea7-af5b-720a090c3b3e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:30.074287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8920d-aa00-4ea7-af5b-720a090c3b3e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:30.074395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8920d-aa00-4ea7-af5b-720a090c3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:30.094032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0ec8920d-aa00-4ea7-af5b-720a090c3b3e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:30.095408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0ec8920d-aa00-4ea7-af5b-720a090c3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:30.106265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 734/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:30.163567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3da283-939e-46a3-adac-eb3c443cca1d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:30.163926 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3da283-939e-46a3-adac-eb3c443cca1d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:30.164347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3da283-939e-46a3-adac-eb3c443cca1d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:30.165761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 739/1473] 10.222.0.48 () {54 vars in 962 bytes} [Fri Jun 17 12:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:30.170915 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64ceeb-92e1-43f9-a239-61bf7918c03c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:30.171207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64ceeb-92e1-43f9-a239-61bf7918c03c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:30.171489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64ceeb-92e1-43f9-a239-61bf7918c03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:30.190739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-eb64ceeb-92e1-43f9-a239-61bf7918c03c None None] MFA Rules not processed for user `984780a6a8df405dbbb2ba4c46dd841c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:30.191948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb64ceeb-92e1-43f9-a239-61bf7918c03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:30.199013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 735/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Jun 17 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:30.206684 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3da283-939e-46a3-adac-eb3c443cca1d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:30.218546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3da283-939e-46a3-adac-eb3c443cca1d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:30.222300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29173-4414-4011-b574-a2d37875d2e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984780a6a8df405dbbb2ba4c46dd841c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:30.222946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29173-4414-4011-b574-a2d37875d2e2 service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:30.223226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29173-4414-4011-b574-a2d37875d2e2 service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:30.223501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29173-4414-4011-b574-a2d37875d2e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:30.232678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d29173-4414-4011-b574-a2d37875d2e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:30.234174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d29173-4414-4011-b574-a2d37875d2e2 service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:30.243582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 740/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:32.486340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c100d0-5b31-41e2-815f-a320681c8932 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:32.486835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c100d0-5b31-41e2-815f-a320681c8932 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:32.486937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c100d0-5b31-41e2-815f-a320681c8932 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:32.488299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 736/1476] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:51:32.494011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbc4b3-8072-495f-bdd2-fc0b75f99364 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:32.494526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbc4b3-8072-495f-bdd2-fc0b75f99364 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:32.494628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbc4b3-8072-495f-bdd2-fc0b75f99364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:32.513669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-34bbc4b3-8072-495f-bdd2-fc0b75f99364 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:32.514904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-34bbc4b3-8072-495f-bdd2-fc0b75f99364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:32.523103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 741/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:32.547179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c100d0-5b31-41e2-815f-a320681c8932 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:32.561424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c100d0-5b31-41e2-815f-a320681c8932 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:32.566934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc52d0b-184f-42c6-ad1d-cb93a0f3e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:32.567601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc52d0b-184f-42c6-ad1d-cb93a0f3e000 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:32.567902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc52d0b-184f-42c6-ad1d-cb93a0f3e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:32.568174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc52d0b-184f-42c6-ad1d-cb93a0f3e000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:32.568910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc52d0b-184f-42c6-ad1d-cb93a0f3e000 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:32.570807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-dcc52d0b-184f-42c6-ad1d-cb93a0f3e000 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:51:32.570807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: warnings.warn(msg) Jun 17 12:51:32.570807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: Jun 17 12:51:32.571964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc52d0b-184f-42c6-ad1d-cb93a0f3e000 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:32.591632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 737/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 17 12:51:32 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:51:34.779881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde687-4378-4b72-9547-ec4ae1acfd2f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:34.780501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde687-4378-4b72-9547-ec4ae1acfd2f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:34.780501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde687-4378-4b72-9547-ec4ae1acfd2f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:34.781807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 742/1479] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:34.788116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44f60-62a2-4b37-9eb7-3be73e68d015 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:34.788577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44f60-62a2-4b37-9eb7-3be73e68d015 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:34.788689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44f60-62a2-4b37-9eb7-3be73e68d015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:34.808858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-aca44f60-62a2-4b37-9eb7-3be73e68d015 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:34.810144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aca44f60-62a2-4b37-9eb7-3be73e68d015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:34.818932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 738/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:34.867166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adde687-4378-4b72-9547-ec4ae1acfd2f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:34.890152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adde687-4378-4b72-9547-ec4ae1acfd2f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:34.897136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a155e85-3e8c-4074-b7de-2145eba32b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:34.897795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a155e85-3e8c-4074-b7de-2145eba32b92 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:34.898077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a155e85-3e8c-4074-b7de-2145eba32b92 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:34.898364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a155e85-3e8c-4074-b7de-2145eba32b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:34.907066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a155e85-3e8c-4074-b7de-2145eba32b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:34.908701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a155e85-3e8c-4074-b7de-2145eba32b92 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:34.918500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 743/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:37.294266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d59de2-c67c-493b-b272-b2158695c7a0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:37.295294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d59de2-c67c-493b-b272-b2158695c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:37.295294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d59de2-c67c-493b-b272-b2158695c7a0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:37.296935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 739/1482] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:51:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:37.303413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40cf8c-bac0-47e5-9d28-c2bf93efb524 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:37.304175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40cf8c-bac0-47e5-9d28-c2bf93efb524 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:37.304274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40cf8c-bac0-47e5-9d28-c2bf93efb524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:37.323685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5e40cf8c-bac0-47e5-9d28-c2bf93efb524 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:37.324899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5e40cf8c-bac0-47e5-9d28-c2bf93efb524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:37.333495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 744/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:37.383724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d59de2-c67c-493b-b272-b2158695c7a0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:37.396693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d59de2-c67c-493b-b272-b2158695c7a0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:37.401241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcd341-d643-4fdb-b2d5-833218303087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:37.401892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcd341-d643-4fdb-b2d5-833218303087 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:37.402209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcd341-d643-4fdb-b2d5-833218303087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:37.402491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcd341-d643-4fdb-b2d5-833218303087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:37.413849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcd341-d643-4fdb-b2d5-833218303087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:37.415561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcd341-d643-4fdb-b2d5-833218303087 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:37.425354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 740/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:39.623240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a86b6-aad3-477d-9194-716da6e4a4b3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:39.623843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a86b6-aad3-477d-9194-716da6e4a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:39.623843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a86b6-aad3-477d-9194-716da6e4a4b3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:39.625947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 745/1485] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:39.634791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b50158-0208-44b4-ac23-f954ae79de80 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:39.635244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b50158-0208-44b4-ac23-f954ae79de80 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:39.635388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b50158-0208-44b4-ac23-f954ae79de80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:39.659605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a6b50158-0208-44b4-ac23-f954ae79de80 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:39.660836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a6b50158-0208-44b4-ac23-f954ae79de80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:39.670307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 741/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:39.711707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a86b6-aad3-477d-9194-716da6e4a4b3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:39.723681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a86b6-aad3-477d-9194-716da6e4a4b3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:39.727539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e317d7-08b6-4891-a2be-a943581d4d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:39.728188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e317d7-08b6-4891-a2be-a943581d4d3d service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:39.728468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e317d7-08b6-4891-a2be-a943581d4d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:39.728740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e317d7-08b6-4891-a2be-a943581d4d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:39.738051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e317d7-08b6-4891-a2be-a943581d4d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:39.739568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e317d7-08b6-4891-a2be-a943581d4d3d service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:39.749541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 746/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:41.997878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4009fdd-a422-43d7-b7ad-1e061d531f7a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:41.998692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4009fdd-a422-43d7-b7ad-1e061d531f7a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:41.998692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4009fdd-a422-43d7-b7ad-1e061d531f7a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:42.000753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 742/1488] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:42.008521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772896-9443-45fd-bfdc-61d28c24eac1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:42.009167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772896-9443-45fd-bfdc-61d28c24eac1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:42.009456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772896-9443-45fd-bfdc-61d28c24eac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:42.029770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-99772896-9443-45fd-bfdc-61d28c24eac1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:42.031019 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-99772896-9443-45fd-bfdc-61d28c24eac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:42.040487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 747/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:42.084157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4009fdd-a422-43d7-b7ad-1e061d531f7a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:42.103095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4009fdd-a422-43d7-b7ad-1e061d531f7a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:42.107385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a23177-265f-4eb7-84f3-fde52bf710f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:42.108069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a23177-265f-4eb7-84f3-fde52bf710f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:42.108353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a23177-265f-4eb7-84f3-fde52bf710f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:42.108624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a23177-265f-4eb7-84f3-fde52bf710f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:42.122493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a23177-265f-4eb7-84f3-fde52bf710f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:42.124838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a23177-265f-4eb7-84f3-fde52bf710f4 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:42.138008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 743/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:44.472033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27421212-aa54-4056-87d6-bf4adfeb8cf6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:44.472612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27421212-aa54-4056-87d6-bf4adfeb8cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:44.472612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27421212-aa54-4056-87d6-bf4adfeb8cf6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:44.474146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 748/1491] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 17 12:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:51:44.480718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4eef-9414-4df0-9ce0-eb3c18ed3cc0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:44.481284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4eef-9414-4df0-9ce0-eb3c18ed3cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:44.481284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce4eef-9414-4df0-9ce0-eb3c18ed3cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:44.503070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9bce4eef-9414-4df0-9ce0-eb3c18ed3cc0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:51:44.504336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9bce4eef-9414-4df0-9ce0-eb3c18ed3cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:51:44.514394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 744/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 17 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:51:44.557833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27421212-aa54-4056-87d6-bf4adfeb8cf6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:51:44.574527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27421212-aa54-4056-87d6-bf4adfeb8cf6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:51:44.579130 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34060106-04c0-4edf-b81e-0d163ab74102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:51:44.579518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34060106-04c0-4edf-b81e-0d163ab74102 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:51:44.579804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34060106-04c0-4edf-b81e-0d163ab74102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:51:44.580080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34060106-04c0-4edf-b81e-0d163ab74102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:51:44.594379 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34060106-04c0-4edf-b81e-0d163ab74102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:51:44.595865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34060106-04c0-4edf-b81e-0d163ab74102 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:51:44.609281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 749/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:51:54.496763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=33 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:51:54.603067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=33 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:13.624202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da45b9-8ed4-4815-8ce4-3a7aded2d571 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:13.624840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da45b9-8ed4-4815-8ce4-3a7aded2d571 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:13.624840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da45b9-8ed4-4815-8ce4-3a7aded2d571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:13.645151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-56da45b9-8ed4-4815-8ce4-3a7aded2d571 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:53:13.646440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-56da45b9-8ed4-4815-8ce4-3a7aded2d571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:53:13.655073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 745/1494] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:53:13.665548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123055-ffc4-402d-8c33-a6afc441b785 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:13.666312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123055-ffc4-402d-8c33-a6afc441b785 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:13.666312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123055-ffc4-402d-8c33-a6afc441b785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:13.686806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6e123055-ffc4-402d-8c33-a6afc441b785 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:53:13.688064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6e123055-ffc4-402d-8c33-a6afc441b785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:53:13.697685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 750/1495] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:53:13.703024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da45b9-8ed4-4815-8ce4-3a7aded2d571 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:13.714493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da45b9-8ed4-4815-8ce4-3a7aded2d571 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:13.721062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:13.721838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:13.722220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:13.722530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:13.723334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:53:13.723775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:13.724934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:53:13.724934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: warnings.warn(msg) Jun 17 12:53:13.724934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: Jun 17 12:53:13.726212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:13.741129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 746/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:53:13.751003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e123055-ffc4-402d-8c33-a6afc441b785 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:13.762599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e123055-ffc4-402d-8c33-a6afc441b785 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:13.768127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ec9a-3b20-4db0-b1e6-cee97343dc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:13.768862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ec9a-3b20-4db0-b1e6-cee97343dc5c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:13.769148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ec9a-3b20-4db0-b1e6-cee97343dc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:13.769428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ec9a-3b20-4db0-b1e6-cee97343dc5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:13.770147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068ec9a-3b20-4db0-b1e6-cee97343dc5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:13.772054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-7068ec9a-3b20-4db0-b1e6-cee97343dc5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:53:13.772054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: warnings.warn(msg) Jun 17 12:53:13.772054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: Jun 17 12:53:13.773272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068ec9a-3b20-4db0-b1e6-cee97343dc5c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:13.831198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 751/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:53:13 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:53:13.836839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:13.847652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7339d-658e-44a3-b4a7-2a5e7606dee5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:13.917052 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0b0b7-ddc1-4dac-ae61-e38210a274d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:13.917952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b0b7-ddc1-4dac-ae61-e38210a274d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:13.918171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b0b7-ddc1-4dac-ae61-e38210a274d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:13.918438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b0b7-ddc1-4dac-ae61-e38210a274d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:13.919622 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0b0b7-ddc1-4dac-ae61-e38210a274d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:13.921506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-78d0b0b7-ddc1-4dac-ae61-e38210a274d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:53:13.921506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: warnings.warn(msg) Jun 17 12:53:13.921506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: Jun 17 12:53:13.923634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0b0b7-ddc1-4dac-ae61-e38210a274d7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:13.951359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 747/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:53:13 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:53:13.956319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ec9a-3b20-4db0-b1e6-cee97343dc5c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:13.973558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ec9a-3b20-4db0-b1e6-cee97343dc5c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:13.980031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa9cdb-5b42-48d8-8673-bdbcc0680892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:13.980809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa9cdb-5b42-48d8-8673-bdbcc0680892 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:13.981264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa9cdb-5b42-48d8-8673-bdbcc0680892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:13.981546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa9cdb-5b42-48d8-8673-bdbcc0680892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:13.982384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa9cdb-5b42-48d8-8673-bdbcc0680892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:13.983498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-57aa9cdb-5b42-48d8-8673-bdbcc0680892 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:53:13.983498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: warnings.warn(msg) Jun 17 12:53:13.983498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: Jun 17 12:53:13.984420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa9cdb-5b42-48d8-8673-bdbcc0680892 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:13.999879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 752/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:53:14.005347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0b0b7-ddc1-4dac-ae61-e38210a274d7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:14.017575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0b0b7-ddc1-4dac-ae61-e38210a274d7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:14.024210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595a1be-cf73-4c25-9816-0aa8012fcb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:14.025096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a1be-cf73-4c25-9816-0aa8012fcb8b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.025380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a1be-cf73-4c25-9816-0aa8012fcb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.025661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595a1be-cf73-4c25-9816-0aa8012fcb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.026432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595a1be-cf73-4c25-9816-0aa8012fcb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:14.027512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-e595a1be-cf73-4c25-9816-0aa8012fcb8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:53:14.027512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: warnings.warn(msg) Jun 17 12:53:14.027512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: Jun 17 12:53:14.028460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595a1be-cf73-4c25-9816-0aa8012fcb8b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:14.045106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 748/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:53:14.049869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa9cdb-5b42-48d8-8673-bdbcc0680892 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:14.061912 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa9cdb-5b42-48d8-8673-bdbcc0680892 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:14.073006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b5973-e8c5-4ca6-af02-265e50fe96a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:14.073971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b5973-e8c5-4ca6-af02-265e50fe96a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.074293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b5973-e8c5-4ca6-af02-265e50fe96a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.074578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b5973-e8c5-4ca6-af02-265e50fe96a0 admin admin] PATH_INFO: `/v3/projects/eaa2fc4014eb4acd99ad4f8d58195538/users/7e3a0d2cb580410fac33ca31ad1011aa/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.093415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b5973-e8c5-4ca6-af02-265e50fe96a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa2fc4014eb4acd99ad4f8d58195538, user_id=7e3a0d2cb580410fac33ca31ad1011aa, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:14.094552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-277b5973-e8c5-4ca6-af02-265e50fe96a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:53:14.094552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: warnings.warn(msg) Jun 17 12:53:14.094552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: Jun 17 12:53:14.096604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b5973-e8c5-4ca6-af02-265e50fe96a0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:14.113239 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 753/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:53:14 2022] PUT /identity/v3/projects/eaa2fc4014eb4acd99ad4f8d58195538/users/7e3a0d2cb580410fac33ca31ad1011aa/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:53:14.126786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23df44-bf86-4cf0-b539-0762eade9117 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.127188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23df44-bf86-4cf0-b539-0762eade9117 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.127517 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23df44-bf86-4cf0-b539-0762eade9117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.158672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bf23df44-bf86-4cf0-b539-0762eade9117 None None] MFA Rules not processed for user `7e3a0d2cb580410fac33ca31ad1011aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:53:14.159939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf23df44-bf86-4cf0-b539-0762eade9117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:53:14.236942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 749/1502] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:53:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:53:14.251755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887a22-c29f-421a-94f1-596db8629c63 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.252035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887a22-c29f-421a-94f1-596db8629c63 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.252290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887a22-c29f-421a-94f1-596db8629c63 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.253708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 754/1503] 10.222.0.48 () {54 vars in 963 bytes} [Fri Jun 17 12:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:53:14.259858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf54ac0-7b59-4295-bbb0-3dcae477e8b6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.260091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf54ac0-7b59-4295-bbb0-3dcae477e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.260400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf54ac0-7b59-4295-bbb0-3dcae477e8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.280872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-faf54ac0-7b59-4295-bbb0-3dcae477e8b6 None None] MFA Rules not processed for user `68fc7c689f3645149d927663730bab5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:53:14.282131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-faf54ac0-7b59-4295-bbb0-3dcae477e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:53:14.339925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:14.351088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 750/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Jun 17 12:53:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:53:14.360037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887a22-c29f-421a-94f1-596db8629c63 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:14.373690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887a22-c29f-421a-94f1-596db8629c63 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:14.379461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ff2b4-a928-4eae-b37b-dabf243e4446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:14.380536 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ff2b4-a928-4eae-b37b-dabf243e4446 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.380956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ff2b4-a928-4eae-b37b-dabf243e4446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.381358 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ff2b4-a928-4eae-b37b-dabf243e4446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.396069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ff2b4-a928-4eae-b37b-dabf243e4446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:14.399188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ff2b4-a928-4eae-b37b-dabf243e4446 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:14.413864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 755/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:53:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:53:14.473159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851caa3e-d401-4c06-9a7b-6a72bb5037c3 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.473419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851caa3e-d401-4c06-9a7b-6a72bb5037c3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.473719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851caa3e-d401-4c06-9a7b-6a72bb5037c3 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.475124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 751/1506] 10.222.0.48 () {52 vars in 829 bytes} [Fri Jun 17 12:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:53:14.480656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ff2b4-a928-4eae-b37b-dabf243e4446 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:14.572870 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ff2b4-a928-4eae-b37b-dabf243e4446 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:14.578403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:14.579362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.579650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.579930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] PATH_INFO: `/v3/users/7e3a0d2cb580410fac33ca31ad1011aa` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.581509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3a0d2cb580410fac33ca31ad1011aa)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:14.582670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:53:14.582670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: warnings.warn(msg) Jun 17 12:53:14.582670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: Jun 17 12:53:14.583990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:14.670296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3a0d2cb580410fac33ca31ad1011aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:14.671226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3a0d2cb580410fac33ca31ad1011aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:14.672018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3a0d2cb580410fac33ca31ad1011aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:14.689340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3a0d2cb580410fac33ca31ad1011aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:14.701360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3a0d2cb580410fac33ca31ad1011aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:14.724104 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:14.739909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 756/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:53:14 2022] DELETE /identity/v3/users/7e3a0d2cb580410fac33ca31ad1011aa => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:53:14.747138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febbac2-4e4c-4e4c-93f1-087e16e0733b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.747978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febbac2-4e4c-4e4c-93f1-087e16e0733b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.748198 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febbac2-4e4c-4e4c-93f1-087e16e0733b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.768181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5febbac2-4e4c-4e4c-93f1-087e16e0733b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:53:14.769473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5febbac2-4e4c-4e4c-93f1-087e16e0733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:53:14.846635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 752/1508] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:53:14.857856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:14.859496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:53:14.939558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580827d-e26a-451b-b2cf-37ffc8e288e0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:14.946701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8608-f186-4866-9ed2-f511c79bba39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:14.947803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8608-f186-4866-9ed2-f511c79bba39 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:14.948311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8608-f186-4866-9ed2-f511c79bba39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:14.948649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8608-f186-4866-9ed2-f511c79bba39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:14.964830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8608-f186-4866-9ed2-f511c79bba39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:14.966432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8608-f186-4866-9ed2-f511c79bba39 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:14.978058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 757/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:53:15.402526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febbac2-4e4c-4e4c-93f1-087e16e0733b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:53:15.404853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5febbac2-4e4c-4e4c-93f1-087e16e0733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:53:15.425725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febbac2-4e4c-4e4c-93f1-087e16e0733b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:53:15.431720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:53:15.433288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:53:15.433781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:53:15.434305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] PATH_INFO: `/v3/projects/eaa2fc4014eb4acd99ad4f8d58195538` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:53:15.436599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa2fc4014eb4acd99ad4f8d58195538)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:53:15.438600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:53:15.438600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: warnings.warn(msg) Jun 17 12:53:15.438600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: Jun 17 12:53:15.440935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:53:15.529592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa2fc4014eb4acd99ad4f8d58195538', 'request_id': 'req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:15.543049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa2fc4014eb4acd99ad4f8d58195538', 'request_id': 'req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:15.558932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa2fc4014eb4acd99ad4f8d58195538', 'request_id': 'req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:15.578380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] The token cache is being invalidate because project eaa2fc4014eb4acd99ad4f8d58195538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:53:15.578875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:15.579781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08bc9a17-0cdd-4b1b-9208-bf92d9c5c4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:53:15.581664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 753/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:53:15 2022] DELETE /identity/v3/projects/eaa2fc4014eb4acd99ad4f8d58195538 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:53:24.972632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:53:25.574362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:54:58.423000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d092a2-a159-41bd-8da0-69a91f26ee5c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:54:58.423642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d092a2-a159-41bd-8da0-69a91f26ee5c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:54:58.423642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d092a2-a159-41bd-8da0-69a91f26ee5c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:54:58.424967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:54:58.430409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd44e-20a5-43ed-912f-ca77d0f875fd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:54:58.430893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd44e-20a5-43ed-912f-ca77d0f875fd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:54:58.430995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd44e-20a5-43ed-912f-ca77d0f875fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:54:58.450955 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ae9cd44e-20a5-43ed-912f-ca77d0f875fd None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:54:58.452212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ae9cd44e-20a5-43ed-912f-ca77d0f875fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:54:58.516260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:54:58.694047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d092a2-a159-41bd-8da0-69a91f26ee5c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:54:58.696112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e2d092a2-a159-41bd-8da0-69a91f26ee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:54:58.772902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d092a2-a159-41bd-8da0-69a91f26ee5c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:54:58.778547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16256c-30e0-431a-8536-62f5d7f9b132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:54:58.779177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16256c-30e0-431a-8536-62f5d7f9b132 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:54:58.779456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16256c-30e0-431a-8536-62f5d7f9b132 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:54:58.779729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16256c-30e0-431a-8536-62f5d7f9b132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:54:58.788685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16256c-30e0-431a-8536-62f5d7f9b132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:54:58.790366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16256c-30e0-431a-8536-62f5d7f9b132 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:54:58.801909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 759/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:54:59.701955 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1cc5f-8021-4dcf-b0d6-7bf6ba9282ce None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:54:59.702588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1cc5f-8021-4dcf-b0d6-7bf6ba9282ce None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:54:59.702588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1cc5f-8021-4dcf-b0d6-7bf6ba9282ce None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:54:59.703988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:54:59.710474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a0108-72c2-434a-bc6f-5514d5720092 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:54:59.711137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a0108-72c2-434a-bc6f-5514d5720092 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:54:59.711306 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a0108-72c2-434a-bc6f-5514d5720092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:54:59.736922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-790a0108-72c2-434a-bc6f-5514d5720092 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:54:59.738688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-790a0108-72c2-434a-bc6f-5514d5720092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:54:59.751591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:54:59.912752 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1cc5f-8021-4dcf-b0d6-7bf6ba9282ce None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:54:59.929903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1cc5f-8021-4dcf-b0d6-7bf6ba9282ce None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:54:59.936043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a82e5-c53d-4a98-8d55-c4f5bcd07e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:54:59.936802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a82e5-c53d-4a98-8d55-c4f5bcd07e7a service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:54:59.937086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a82e5-c53d-4a98-8d55-c4f5bcd07e7a service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:54:59.937364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a82e5-c53d-4a98-8d55-c4f5bcd07e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:54:59.947636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a82e5-c53d-4a98-8d55-c4f5bcd07e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:54:59.949316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a82e5-c53d-4a98-8d55-c4f5bcd07e7a service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:54:59.960985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 756/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:55:00.364718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc3226-73c4-404b-8613-eb0dfcf279d4 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:00.365033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc3226-73c4-404b-8613-eb0dfcf279d4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:00.365450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc3226-73c4-404b-8613-eb0dfcf279d4 None None] PATH_INFO: `/v3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:00.366923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 761/1517] 10.222.0.75 () {54 vars in 925 bytes} [Fri Jun 17 12:55:00 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:55:00.374892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59ad62-c875-4513-abcc-c468c8abf367 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:00.375365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59ad62-c875-4513-abcc-c468c8abf367 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:00.375726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59ad62-c875-4513-abcc-c468c8abf367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:00.400159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1a59ad62-c875-4513-abcc-c468c8abf367 None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:55:00.401753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1a59ad62-c875-4513-abcc-c468c8abf367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:00.505547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 757/1518] 10.222.0.75 () {58 vars in 1015 bytes} [Fri Jun 17 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:55:09.729494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=37 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:09.906496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196adefd-6456-4d6c-8392-e90b095a948e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:09.906952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196adefd-6456-4d6c-8392-e90b095a948e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:09.907345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196adefd-6456-4d6c-8392-e90b095a948e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:09.909073 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 762/1519] 10.222.0.48 () {54 vars in 960 bytes} [Fri Jun 17 12:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:55:09.916312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a94a1a-3295-4a82-9060-8d99d1a7c3ab None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:09.916939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a94a1a-3295-4a82-9060-8d99d1a7c3ab None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:09.917058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a94a1a-3295-4a82-9060-8d99d1a7c3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:09.939037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-71a94a1a-3295-4a82-9060-8d99d1a7c3ab None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:55:09.940555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-71a94a1a-3295-4a82-9060-8d99d1a7c3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:09.951874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 758/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Fri Jun 17 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:55:09.961260 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196adefd-6456-4d6c-8392-e90b095a948e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:55:09.976296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196adefd-6456-4d6c-8392-e90b095a948e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:55:09.981648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b8502-dce1-4da1-9985-fe83ed1b552c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:55:09.982363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8502-dce1-4da1-9985-fe83ed1b552c service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:09.982655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8502-dce1-4da1-9985-fe83ed1b552c service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:09.982943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8502-dce1-4da1-9985-fe83ed1b552c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:09.993220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b8502-dce1-4da1-9985-fe83ed1b552c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:55:09.994978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b8502-dce1-4da1-9985-fe83ed1b552c service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:55:10.007587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 763/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:55:11.508046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca937503-8b97-46cb-ae16-b3eb36604c76 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:11.508684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca937503-8b97-46cb-ae16-b3eb36604c76 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:11.508684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca937503-8b97-46cb-ae16-b3eb36604c76 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:11.510374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:55:11.517399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41438-1dd5-42c1-b498-bc0bf1767202 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:11.518003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41438-1dd5-42c1-b498-bc0bf1767202 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:11.518417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41438-1dd5-42c1-b498-bc0bf1767202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:11.546034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bed41438-1dd5-42c1-b498-bc0bf1767202 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:55:11.547598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bed41438-1dd5-42c1-b498-bc0bf1767202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:11.557004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:55:11.753348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca937503-8b97-46cb-ae16-b3eb36604c76 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:55:11.770490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca937503-8b97-46cb-ae16-b3eb36604c76 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:55:11.777944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85e195-2554-46cf-b825-6c95a1d14163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:55:11.778674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85e195-2554-46cf-b825-6c95a1d14163 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:11.778988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85e195-2554-46cf-b825-6c95a1d14163 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:11.779266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85e195-2554-46cf-b825-6c95a1d14163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:11.794823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85e195-2554-46cf-b825-6c95a1d14163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:55:11.798230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85e195-2554-46cf-b825-6c95a1d14163 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:55:11.816767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 760/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:55:12.723817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cddeec-4b64-4252-9f56-cbdd678a96f7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:12.724544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cddeec-4b64-4252-9f56-cbdd678a96f7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:12.724544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cddeec-4b64-4252-9f56-cbdd678a96f7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:12.726980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 12:55:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:55:12.735696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f900-a6c0-4cd7-94d2-70af932d9554 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:12.736301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f900-a6c0-4cd7-94d2-70af932d9554 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:12.736678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f900-a6c0-4cd7-94d2-70af932d9554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:12.768633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e755f900-a6c0-4cd7-94d2-70af932d9554 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:55:12.770805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e755f900-a6c0-4cd7-94d2-70af932d9554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:12.784925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 12:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:55:13.053657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cddeec-4b64-4252-9f56-cbdd678a96f7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:55:13.072017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cddeec-4b64-4252-9f56-cbdd678a96f7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:55:13.078736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8068f3-6c14-41f1-8614-a063b67d0302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:55:13.079435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8068f3-6c14-41f1-8614-a063b67d0302 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:13.079711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8068f3-6c14-41f1-8614-a063b67d0302 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:13.080088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8068f3-6c14-41f1-8614-a063b67d0302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:13.090221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8068f3-6c14-41f1-8614-a063b67d0302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:55:13.091904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8068f3-6c14-41f1-8614-a063b67d0302 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:55:13.103788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 766/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:55:17.588684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53574cb-02b4-48eb-a49f-ffaab4b8068d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:17.589282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53574cb-02b4-48eb-a49f-ffaab4b8068d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:17.589282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53574cb-02b4-48eb-a49f-ffaab4b8068d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:17.590654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:55:17.597489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e597e44-96e2-4afa-9954-0e2dfc19b137 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:17.598081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e597e44-96e2-4afa-9954-0e2dfc19b137 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:17.598081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e597e44-96e2-4afa-9954-0e2dfc19b137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:17.621536 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7e597e44-96e2-4afa-9954-0e2dfc19b137 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:55:17.623176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7e597e44-96e2-4afa-9954-0e2dfc19b137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:17.632522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:55:17.676838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53574cb-02b4-48eb-a49f-ffaab4b8068d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:55:17.679344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f53574cb-02b4-48eb-a49f-ffaab4b8068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:17.746369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53574cb-02b4-48eb-a49f-ffaab4b8068d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:55:17.750605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c120b-4d5b-4b64-a954-68d0c502d997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:55:17.751283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c120b-4d5b-4b64-a954-68d0c502d997 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:17.751573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c120b-4d5b-4b64-a954-68d0c502d997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:17.751851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c120b-4d5b-4b64-a954-68d0c502d997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:17.762289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c120b-4d5b-4b64-a954-68d0c502d997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:55:17.763781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c120b-4d5b-4b64-a954-68d0c502d997 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:55:17.769584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:17.776267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 763/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:55:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:55:20.017812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e62f52-b2a1-4d30-88a8-6b56cf1f8f46 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:20.018471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e62f52-b2a1-4d30-88a8-6b56cf1f8f46 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:20.018471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e62f52-b2a1-4d30-88a8-6b56cf1f8f46 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:20.019823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:55:20.026889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cdadc-7875-4b81-bf00-010768549b11 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:20.027569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cdadc-7875-4b81-bf00-010768549b11 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:20.027569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cdadc-7875-4b81-bf00-010768549b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:20.048301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f28cdadc-7875-4b81-bf00-010768549b11 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:55:20.049813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f28cdadc-7875-4b81-bf00-010768549b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:20.059469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:55:20.097601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e62f52-b2a1-4d30-88a8-6b56cf1f8f46 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:55:20.110790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e62f52-b2a1-4d30-88a8-6b56cf1f8f46 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:55:20.115647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb165300-c997-41c9-94f1-3adcf2d4c1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:55:20.116388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb165300-c997-41c9-94f1-3adcf2d4c1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:20.116707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb165300-c997-41c9-94f1-3adcf2d4c1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:20.117022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb165300-c997-41c9-94f1-3adcf2d4c1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:20.128423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb165300-c997-41c9-94f1-3adcf2d4c1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:55:20.129962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb165300-c997-41c9-94f1-3adcf2d4c1a8 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:55:20.142401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 769/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:55:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:55:24.277306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea3494-a606-4e6c-bc24-42ae7b1f0edb None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:24.278021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea3494-a606-4e6c-bc24-42ae7b1f0edb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:24.278021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea3494-a606-4e6c-bc24-42ae7b1f0edb None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:24.279303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:55:24.287585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f45c8-e46a-46ce-98ae-5bbfe47e9d85 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:24.288257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f45c8-e46a-46ce-98ae-5bbfe47e9d85 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:24.288629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f45c8-e46a-46ce-98ae-5bbfe47e9d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:24.321146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-af1f45c8-e46a-46ce-98ae-5bbfe47e9d85 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:55:24.323254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-af1f45c8-e46a-46ce-98ae-5bbfe47e9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:24.337095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:55:24.629238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea3494-a606-4e6c-bc24-42ae7b1f0edb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:55:24.632154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8fea3494-a606-4e6c-bc24-42ae7b1f0edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:24.717565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea3494-a606-4e6c-bc24-42ae7b1f0edb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:55:24.722137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275dd14-063d-44dc-9cdd-41cb71a61388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:55:24.722945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275dd14-063d-44dc-9cdd-41cb71a61388 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:24.723272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275dd14-063d-44dc-9cdd-41cb71a61388 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:24.723593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275dd14-063d-44dc-9cdd-41cb71a61388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:24.735379 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275dd14-063d-44dc-9cdd-41cb71a61388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:55:24.737042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275dd14-063d-44dc-9cdd-41cb71a61388 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:55:24.749526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 766/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:55:27.121004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508af13e-cbe3-4a56-89be-fea073a22cf5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:27.121686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508af13e-cbe3-4a56-89be-fea073a22cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:27.121686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508af13e-cbe3-4a56-89be-fea073a22cf5 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:27.123697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 12:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:55:27.130247 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00b487-e456-496d-86b3-a28cc6e99298 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:27.130937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00b487-e456-496d-86b3-a28cc6e99298 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:27.130937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00b487-e456-496d-86b3-a28cc6e99298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:27.158914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2b00b487-e456-496d-86b3-a28cc6e99298 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:55:27.161109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2b00b487-e456-496d-86b3-a28cc6e99298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:27.175241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:55:27.455454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508af13e-cbe3-4a56-89be-fea073a22cf5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:55:27.458248 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-508af13e-cbe3-4a56-89be-fea073a22cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:55:27.480453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508af13e-cbe3-4a56-89be-fea073a22cf5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:55:27.486181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e3709-c407-4459-a11c-31be42f85ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:55:27.487290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3709-c407-4459-a11c-31be42f85ffc service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:55:27.487749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3709-c407-4459-a11c-31be42f85ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:55:27.488222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3709-c407-4459-a11c-31be42f85ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:55:27.505183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e3709-c407-4459-a11c-31be42f85ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:55:27.508046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e3709-c407-4459-a11c-31be42f85ffc service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:55:27.527082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 772/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:55:37.150582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=32 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:55:37.518211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=33 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:57.462279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dc78e-2161-4930-b706-e4806f956446 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:57.463483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dc78e-2161-4930-b706-e4806f956446 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:57.463989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dc78e-2161-4930-b706-e4806f956446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:57.494896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5e3dc78e-2161-4930-b706-e4806f956446 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:57.496541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5e3dc78e-2161-4930-b706-e4806f956446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:57.508462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 768/1540] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:57.519824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f280-aab5-4601-886b-9c96bb66c3a8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:57.520871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f280-aab5-4601-886b-9c96bb66c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:57.521361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f280-aab5-4601-886b-9c96bb66c3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:57.546935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9216f280-aab5-4601-886b-9c96bb66c3a8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:57.548550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9216f280-aab5-4601-886b-9c96bb66c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:57.566942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 773/1541] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:57.572865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dc78e-2161-4930-b706-e4806f956446 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:57.587877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dc78e-2161-4930-b706-e4806f956446 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:57.597127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb26f94-a5e9-41ed-8883-a6557fb75fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:57.597841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb26f94-a5e9-41ed-8883-a6557fb75fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:57.598141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb26f94-a5e9-41ed-8883-a6557fb75fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:57.598423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb26f94-a5e9-41ed-8883-a6557fb75fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:57.599315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb26f94-a5e9-41ed-8883-a6557fb75fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:56:57.599629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb26f94-a5e9-41ed-8883-a6557fb75fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:57.601522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb26f94-a5e9-41ed-8883-a6557fb75fe5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:57.623142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 769/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:56:57.632337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f280-aab5-4601-886b-9c96bb66c3a8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:57.646895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f280-aab5-4601-886b-9c96bb66c3a8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:57.652192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82822d-b950-480e-9e30-fb005e5a50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:57.653574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82822d-b950-480e-9e30-fb005e5a50e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:57.654124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82822d-b950-480e-9e30-fb005e5a50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:57.654627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82822d-b950-480e-9e30-fb005e5a50e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:57.655681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82822d-b950-480e-9e30-fb005e5a50e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:57.657960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82822d-b950-480e-9e30-fb005e5a50e5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:57.701029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 774/1543] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:56:57 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:57.706665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb26f94-a5e9-41ed-8883-a6557fb75fe5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:57.721444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb26f94-a5e9-41ed-8883-a6557fb75fe5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:57.825680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087c677-aee2-4546-8e5c-1059be777f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:57.826343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087c677-aee2-4546-8e5c-1059be777f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:57.826624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087c677-aee2-4546-8e5c-1059be777f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:57.826903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087c677-aee2-4546-8e5c-1059be777f87 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:57.827913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087c677-aee2-4546-8e5c-1059be777f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:57.829969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087c677-aee2-4546-8e5c-1059be777f87 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:57.864028 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746e37-840a-4d27-bfbf-c7d36cd25fad None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:57.868454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746e37-840a-4d27-bfbf-c7d36cd25fad None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:57.869550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746e37-840a-4d27-bfbf-c7d36cd25fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:57.876060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 770/1544] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:56:57 2022] POST /identity/v3/users => generated 282 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:57.885687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087c677-aee2-4546-8e5c-1059be777f87 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:57.901842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087c677-aee2-4546-8e5c-1059be777f87 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:57.912347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ba746e37-840a-4d27-bfbf-c7d36cd25fad None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:57.914263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ba746e37-840a-4d27-bfbf-c7d36cd25fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:57.926132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597ee61-fada-4193-a06b-97d182676ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:57.926132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ee61-fada-4193-a06b-97d182676ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:57.926491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ee61-fada-4193-a06b-97d182676ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:57.926909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597ee61-fada-4193-a06b-97d182676ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:57.928502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597ee61-fada-4193-a06b-97d182676ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:57.931823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 775/1545] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:57.933686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45028f41-a316-4f9e-a853-3ebaa6707ea7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:57.934357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45028f41-a316-4f9e-a853-3ebaa6707ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:57.934879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45028f41-a316-4f9e-a853-3ebaa6707ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:57.935131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597ee61-fada-4193-a06b-97d182676ef1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:57.977172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 771/1546] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:56:57.978713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325acf0-a2f0-4fb1-a7a1-18353c909e3e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:57.979233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325acf0-a2f0-4fb1-a7a1-18353c909e3e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:57.979706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325acf0-a2f0-4fb1-a7a1-18353c909e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:57.980945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-45028f41-a316-4f9e-a853-3ebaa6707ea7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:57.982504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-45028f41-a316-4f9e-a853-3ebaa6707ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:57.999956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 776/1547] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.001524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45028f41-a316-4f9e-a853-3ebaa6707ea7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.017220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45028f41-a316-4f9e-a853-3ebaa6707ea7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.034604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81badca-7f74-4253-b7bc-c9e361f85495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.035787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81badca-7f74-4253-b7bc-c9e361f85495 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.036307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81badca-7f74-4253-b7bc-c9e361f85495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.036833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81badca-7f74-4253-b7bc-c9e361f85495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.037863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81badca-7f74-4253-b7bc-c9e361f85495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.039872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81badca-7f74-4253-b7bc-c9e361f85495 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.052856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2325acf0-a2f0-4fb1-a7a1-18353c909e3e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.055133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2325acf0-a2f0-4fb1-a7a1-18353c909e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.061165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 777/1548] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:56:58.063516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41159bc-d04a-4788-a571-59ff5d2d68e0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.064209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41159bc-d04a-4788-a571-59ff5d2d68e0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.064714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41159bc-d04a-4788-a571-59ff5d2d68e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.080401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 772/1549] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.081836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325acf0-a2f0-4fb1-a7a1-18353c909e3e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.119841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325acf0-a2f0-4fb1-a7a1-18353c909e3e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.122161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e41159bc-d04a-4788-a571-59ff5d2d68e0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.125565 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e41159bc-d04a-4788-a571-59ff5d2d68e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.137768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe052c-0d9a-479e-9ce0-ba5cca061ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.139185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe052c-0d9a-479e-9ce0-ba5cca061ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.139749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe052c-0d9a-479e-9ce0-ba5cca061ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.140261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe052c-0d9a-479e-9ce0-ba5cca061ed0 admin admin] PATH_INFO: `/v3/projects/11083bc01e5140c9b8e947efd72362af/users/b4a39c82edb5499ca77ea0882a9c09f2/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.153511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 778/1550] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.160594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41159bc-d04a-4788-a571-59ff5d2d68e0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.182051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41159bc-d04a-4788-a571-59ff5d2d68e0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.184634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe052c-0d9a-479e-9ce0-ba5cca061ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11083bc01e5140c9b8e947efd72362af, user_id=b4a39c82edb5499ca77ea0882a9c09f2, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.190287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-2afe052c-0d9a-479e-9ce0-ba5cca061ed0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:56:58.190287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: warnings.warn(msg) Jun 17 12:56:58.190287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: Jun 17 12:56:58.193554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe052c-0d9a-479e-9ce0-ba5cca061ed0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.202142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d0843-9f21-4c0d-8b25-91c9db19de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.203874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0843-9f21-4c0d-8b25-91c9db19de65 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.206200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0843-9f21-4c0d-8b25-91c9db19de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.208206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0843-9f21-4c0d-8b25-91c9db19de65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.210162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d0843-9f21-4c0d-8b25-91c9db19de65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:56:58.211035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d0843-9f21-4c0d-8b25-91c9db19de65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.213266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-e78d0843-9f21-4c0d-8b25-91c9db19de65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:56:58.213266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: warnings.warn(msg) Jun 17 12:56:58.213266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: Jun 17 12:56:58.219295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d0843-9f21-4c0d-8b25-91c9db19de65 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.242477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 773/1551] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:56:58 2022] PUT /identity/v3/projects/11083bc01e5140c9b8e947efd72362af/users/b4a39c82edb5499ca77ea0882a9c09f2/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:56:58.244564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe052c-0d9a-479e-9ce0-ba5cca061ed0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.256465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 779/1552] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:56:58.259160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abffae-8afd-4e61-ad26-c8014f3dabdb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.259944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abffae-8afd-4e61-ad26-c8014f3dabdb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.260643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abffae-8afd-4e61-ad26-c8014f3dabdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.293086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-33abffae-8afd-4e61-ad26-c8014f3dabdb None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.295682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-33abffae-8afd-4e61-ad26-c8014f3dabdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.371629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe052c-0d9a-479e-9ce0-ba5cca061ed0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.376895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2348997-ded9-4fa0-a556-4d8d6a04f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.377590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2348997-ded9-4fa0-a556-4d8d6a04f7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.377868 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2348997-ded9-4fa0-a556-4d8d6a04f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.378184 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2348997-ded9-4fa0-a556-4d8d6a04f7f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.378925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2348997-ded9-4fa0-a556-4d8d6a04f7f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:56:58.379518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2348997-ded9-4fa0-a556-4d8d6a04f7f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.381152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2348997-ded9-4fa0-a556-4d8d6a04f7f5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.383812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 780/1553] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.387592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15bdf-09fe-4480-b5e5-b221e541b715 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.387956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15bdf-09fe-4480-b5e5-b221e541b715 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.388246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15bdf-09fe-4480-b5e5-b221e541b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.398144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 774/1554] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:56:58.398144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245402-c1b5-467e-b7b4-e292cf5b7092 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.398144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245402-c1b5-467e-b7b4-e292cf5b7092 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.398510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245402-c1b5-467e-b7b4-e292cf5b7092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.410530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7cf15bdf-09fe-4480-b5e5-b221e541b715 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.411760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7cf15bdf-09fe-4480-b5e5-b221e541b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.420617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 781/1555] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.421157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15bdf-09fe-4480-b5e5-b221e541b715 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.426917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d1245402-c1b5-467e-b7b4-e292cf5b7092 None None] MFA Rules not processed for user `b4a39c82edb5499ca77ea0882a9c09f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.428408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d1245402-c1b5-467e-b7b4-e292cf5b7092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.431161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15bdf-09fe-4480-b5e5-b221e541b715 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.435717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7959f-b6ca-4b30-8ee0-dc90e39c10fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.436397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7959f-b6ca-4b30-8ee0-dc90e39c10fc admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.436893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7959f-b6ca-4b30-8ee0-dc90e39c10fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.437069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7959f-b6ca-4b30-8ee0-dc90e39c10fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.438224 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7959f-b6ca-4b30-8ee0-dc90e39c10fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.438383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:58.439887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7959f-b6ca-4b30-8ee0-dc90e39c10fc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.471777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 782/1556] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:58.471777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a7111-c283-4b22-b1ac-f609a3f22aa7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.471777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a7111-c283-4b22-b1ac-f609a3f22aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.472177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a7111-c283-4b22-b1ac-f609a3f22aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.491752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6f8a7111-c283-4b22-b1ac-f609a3f22aa7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.494305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6f8a7111-c283-4b22-b1ac-f609a3f22aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.501313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 775/1557] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.502712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec0ce-bb8a-430f-9d41-a415b0766017 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.502999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec0ce-bb8a-430f-9d41-a415b0766017 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.503280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec0ce-bb8a-430f-9d41-a415b0766017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.523435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bf4ec0ce-bb8a-430f-9d41-a415b0766017 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.524557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf4ec0ce-bb8a-430f-9d41-a415b0766017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.551151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:58.561850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 783/1558] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.563569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad6897-f8ed-407b-9b58-5e2da5e5b1a6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.563833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad6897-f8ed-407b-9b58-5e2da5e5b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.564226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad6897-f8ed-407b-9b58-5e2da5e5b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.584365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-20ad6897-f8ed-407b-9b58-5e2da5e5b1a6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.585606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-20ad6897-f8ed-407b-9b58-5e2da5e5b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.592907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 776/1559] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.594332 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfcdd6-fb30-4e30-8aff-5e46662be1ea None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.594625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfcdd6-fb30-4e30-8aff-5e46662be1ea None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.594901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfcdd6-fb30-4e30-8aff-5e46662be1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.603086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 784/1560] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.604549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad6897-f8ed-407b-9b58-5e2da5e5b1a6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.622081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad6897-f8ed-407b-9b58-5e2da5e5b1a6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.622499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-98bfcdd6-fb30-4e30-8aff-5e46662be1ea None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.624183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-98bfcdd6-fb30-4e30-8aff-5e46662be1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.627469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443151c8-cf6d-4fac-8a25-fcf4a20499e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.628152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443151c8-cf6d-4fac-8a25-fcf4a20499e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.628436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443151c8-cf6d-4fac-8a25-fcf4a20499e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.628716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443151c8-cf6d-4fac-8a25-fcf4a20499e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.629424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443151c8-cf6d-4fac-8a25-fcf4a20499e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.631482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443151c8-cf6d-4fac-8a25-fcf4a20499e5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.633408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 777/1561] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.634757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78603c-dc9c-4e7a-afda-dfd61d4d5ec1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.635049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78603c-dc9c-4e7a-afda-dfd61d4d5ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.635323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78603c-dc9c-4e7a-afda-dfd61d4d5ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.654239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ef78603c-dc9c-4e7a-afda-dfd61d4d5ec1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.655581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ef78603c-dc9c-4e7a-afda-dfd61d4d5ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.664087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 785/1562] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:58.665395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 778/1563] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.665547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443151c8-cf6d-4fac-8a25-fcf4a20499e5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.667111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78603c-dc9c-4e7a-afda-dfd61d4d5ec1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.732131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78603c-dc9c-4e7a-afda-dfd61d4d5ec1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.754614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443151c8-cf6d-4fac-8a25-fcf4a20499e5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.759938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8746e-06fa-4751-b6a4-4c6bac052037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.760649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8746e-06fa-4751-b6a4-4c6bac052037 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.760935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8746e-06fa-4751-b6a4-4c6bac052037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.761264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8746e-06fa-4751-b6a4-4c6bac052037 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.761974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8746e-06fa-4751-b6a4-4c6bac052037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.763095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-b4b8746e-06fa-4751-b6a4-4c6bac052037 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:56:58.763095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: warnings.warn(msg) Jun 17 12:56:58.763095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: Jun 17 12:56:58.764335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8746e-06fa-4751-b6a4-4c6bac052037 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.787493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 786/1564] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:58.788840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7f621-01ff-40cf-ace8-e7bf00355c7c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.789125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7f621-01ff-40cf-ace8-e7bf00355c7c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.789411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7f621-01ff-40cf-ace8-e7bf00355c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.792022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3650d37-e0ce-47db-a086-8a369462850b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.792930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3650d37-e0ce-47db-a086-8a369462850b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.793420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3650d37-e0ce-47db-a086-8a369462850b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.793679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3650d37-e0ce-47db-a086-8a369462850b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.807721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:58.812203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0ab7f621-01ff-40cf-ace8-e7bf00355c7c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.813477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0ab7f621-01ff-40cf-ace8-e7bf00355c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.822494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 787/1565] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.823849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e875d-7365-42d5-94dc-12428bc3db1a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.824135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e875d-7365-42d5-94dc-12428bc3db1a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.824409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e875d-7365-42d5-94dc-12428bc3db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.851410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ac5e875d-7365-42d5-94dc-12428bc3db1a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.853603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ac5e875d-7365-42d5-94dc-12428bc3db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.867224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3650d37-e0ce-47db-a086-8a369462850b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.867847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 788/1566] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.868757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3650d37-e0ce-47db-a086-8a369462850b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.869990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558972f3-4c62-42ec-829c-5ddd12128b32 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.870531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558972f3-4c62-42ec-829c-5ddd12128b32 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.871035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558972f3-4c62-42ec-829c-5ddd12128b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.881426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 779/1567] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:56:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:56:58.882685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3650d37-e0ce-47db-a086-8a369462850b service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.896187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3650d37-e0ce-47db-a086-8a369462850b service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.902852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226412d3-58b8-445f-986f-42dc8089f26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.904595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226412d3-58b8-445f-986f-42dc8089f26b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.904866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-558972f3-4c62-42ec-829c-5ddd12128b32 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:58.905807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226412d3-58b8-445f-986f-42dc8089f26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.906341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226412d3-58b8-445f-986f-42dc8089f26b admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.907015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-558972f3-4c62-42ec-829c-5ddd12128b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:58.908303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226412d3-58b8-445f-986f-42dc8089f26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:56:58.909298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226412d3-58b8-445f-986f-42dc8089f26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.911894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226412d3-58b8-445f-986f-42dc8089f26b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.920286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 789/1568] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:58.921194 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558972f3-4c62-42ec-829c-5ddd12128b32 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.926568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 780/1569] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:56:58.927451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226412d3-58b8-445f-986f-42dc8089f26b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.937384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558972f3-4c62-42ec-829c-5ddd12128b32 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.943428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226412d3-58b8-445f-986f-42dc8089f26b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:58.945361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2354ad-bb5b-4f8f-abac-27dd0b5c0cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.946601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2354ad-bb5b-4f8f-abac-27dd0b5c0cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.947092 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2354ad-bb5b-4f8f-abac-27dd0b5c0cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.947589 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2354ad-bb5b-4f8f-abac-27dd0b5c0cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.948743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eadf2f-d57e-4de5-ad0c-01e9777d23dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:58.948895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2354ad-bb5b-4f8f-abac-27dd0b5c0cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.949435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eadf2f-d57e-4de5-ad0c-01e9777d23dc admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:58.949718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eadf2f-d57e-4de5-ad0c-01e9777d23dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:58.950000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eadf2f-d57e-4de5-ad0c-01e9777d23dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:58.950810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eadf2f-d57e-4de5-ad0c-01e9777d23dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:56:58.951120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eadf2f-d57e-4de5-ad0c-01e9777d23dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:58.952756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2354ad-bb5b-4f8f-abac-27dd0b5c0cd5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.952903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eadf2f-d57e-4de5-ad0c-01e9777d23dc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:58.981245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 781/1570] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:56:58.983840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eadf2f-d57e-4de5-ad0c-01e9777d23dc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:58.994977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 790/1571] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:56:58 2022] POST /identity/v3/users => generated 286 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:58.996928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2354ad-bb5b-4f8f-abac-27dd0b5c0cd5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.012917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eadf2f-d57e-4de5-ad0c-01e9777d23dc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.017699 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2354ad-bb5b-4f8f-abac-27dd0b5c0cd5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.021495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75165cb-12e3-4563-9221-524be6901a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.022818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75165cb-12e3-4563-9221-524be6901a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.025076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75165cb-12e3-4563-9221-524be6901a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.025661 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7048f-6b75-47fd-8e17-3c0b1f4e660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.025890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75165cb-12e3-4563-9221-524be6901a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.026900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7048f-6b75-47fd-8e17-3c0b1f4e660b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.027431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75165cb-12e3-4563-9221-524be6901a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.027606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7048f-6b75-47fd-8e17-3c0b1f4e660b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.028040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7048f-6b75-47fd-8e17-3c0b1f4e660b admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.029497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7048f-6b75-47fd-8e17-3c0b1f4e660b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:56:59.030076 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7048f-6b75-47fd-8e17-3c0b1f4e660b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.031180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75165cb-12e3-4563-9221-524be6901a40 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.033159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7048f-6b75-47fd-8e17-3c0b1f4e660b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.051010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 782/1572] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:56:59.054676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75165cb-12e3-4563-9221-524be6901a40 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.057208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 791/1573] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:56:59.057938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7048f-6b75-47fd-8e17-3c0b1f4e660b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.065554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75165cb-12e3-4563-9221-524be6901a40 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.070883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115010c-3347-4247-803c-191a3bd22dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.071793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115010c-3347-4247-803c-191a3bd22dad admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.072123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115010c-3347-4247-803c-191a3bd22dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.072428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115010c-3347-4247-803c-191a3bd22dad admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.073201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115010c-3347-4247-803c-191a3bd22dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:56:59.073512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115010c-3347-4247-803c-191a3bd22dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.075199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115010c-3347-4247-803c-191a3bd22dad admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.076100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7048f-6b75-47fd-8e17-3c0b1f4e660b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.083480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7659de-b5a5-4a92-9da2-3c8c7618243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.084470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7659de-b5a5-4a92-9da2-3c8c7618243c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.084470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7659de-b5a5-4a92-9da2-3c8c7618243c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.085183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7659de-b5a5-4a92-9da2-3c8c7618243c admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.085946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7659de-b5a5-4a92-9da2-3c8c7618243c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:56:59.086283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7659de-b5a5-4a92-9da2-3c8c7618243c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.088312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7659de-b5a5-4a92-9da2-3c8c7618243c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.090408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 783/1574] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:56:59.090408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115010c-3347-4247-803c-191a3bd22dad admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.101755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115010c-3347-4247-803c-191a3bd22dad admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.108062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7308c-62cb-4525-99cb-83dcb70ae793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.114717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 792/1575] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:56:59.114939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7308c-62cb-4525-99cb-83dcb70ae793 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.114939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7308c-62cb-4525-99cb-83dcb70ae793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.114939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7308c-62cb-4525-99cb-83dcb70ae793 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.115247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7659de-b5a5-4a92-9da2-3c8c7618243c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.115347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7308c-62cb-4525-99cb-83dcb70ae793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.115347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-f1e7308c-62cb-4525-99cb-83dcb70ae793 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:56:59.115347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: warnings.warn(msg) Jun 17 12:56:59.115347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: Jun 17 12:56:59.115347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7308c-62cb-4525-99cb-83dcb70ae793 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.128629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7659de-b5a5-4a92-9da2-3c8c7618243c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.136448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda10552-771a-4891-9cb8-4a4f267c3228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.137138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda10552-771a-4891-9cb8-4a4f267c3228 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.137438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda10552-771a-4891-9cb8-4a4f267c3228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.137733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda10552-771a-4891-9cb8-4a4f267c3228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.138541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda10552-771a-4891-9cb8-4a4f267c3228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.141520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda10552-771a-4891-9cb8-4a4f267c3228 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.151303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 784/1576] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.152011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7308c-62cb-4525-99cb-83dcb70ae793 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.178925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 793/1577] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.180033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda10552-771a-4891-9cb8-4a4f267c3228 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.233005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:59.236492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7308c-62cb-4525-99cb-83dcb70ae793 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.279811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda10552-771a-4891-9cb8-4a4f267c3228 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.286257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4d37-a481-41e2-b813-8df5d25cc9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.287088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4d37-a481-41e2-b813-8df5d25cc9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.287442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4d37-a481-41e2-b813-8df5d25cc9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.287820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e4d37-a481-41e2-b813-8df5d25cc9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.288716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4d37-a481-41e2-b813-8df5d25cc9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.290665 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e4d37-a481-41e2-b813-8df5d25cc9ee admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.296614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:59.310349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 794/1578] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:56:59.310349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4d37-a481-41e2-b813-8df5d25cc9ee admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.321962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e4d37-a481-41e2-b813-8df5d25cc9ee admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.325131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf66b-3fe4-4317-8744-a0362a4c6afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.325934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf66b-3fe4-4317-8744-a0362a4c6afa admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.328574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf66b-3fe4-4317-8744-a0362a4c6afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.328574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf66b-3fe4-4317-8744-a0362a4c6afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.328574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cf66b-3fe4-4317-8744-a0362a4c6afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.329913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cf66b-3fe4-4317-8744-a0362a4c6afa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.331047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d27a2-e40e-495b-844f-3b6b0914c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.331807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d27a2-e40e-495b-844f-3b6b0914c61b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.332188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d27a2-e40e-495b-844f-3b6b0914c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.332546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d27a2-e40e-495b-844f-3b6b0914c61b admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.333325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d27a2-e40e-495b-844f-3b6b0914c61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.335402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d27a2-e40e-495b-844f-3b6b0914c61b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.346382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 785/1579] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:56:59.346382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf66b-3fe4-4317-8744-a0362a4c6afa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.362798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf66b-3fe4-4317-8744-a0362a4c6afa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.368359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d642816-b1f9-416d-8def-fe825fc1cdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.369047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d642816-b1f9-416d-8def-fe825fc1cdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.369446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d642816-b1f9-416d-8def-fe825fc1cdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.369827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d642816-b1f9-416d-8def-fe825fc1cdf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.370582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d642816-b1f9-416d-8def-fe825fc1cdf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.372496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 795/1580] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.372731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d642816-b1f9-416d-8def-fe825fc1cdf2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.375213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d27a2-e40e-495b-844f-3b6b0914c61b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.418611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 786/1581] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.419402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d642816-b1f9-416d-8def-fe825fc1cdf2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.457592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d27a2-e40e-495b-844f-3b6b0914c61b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.509113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d642816-b1f9-416d-8def-fe825fc1cdf2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.515361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573c30-71f8-4997-b6f6-144579fc4ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.516198 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573c30-71f8-4997-b6f6-144579fc4ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.516367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573c30-71f8-4997-b6f6-144579fc4ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.516625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573c30-71f8-4997-b6f6-144579fc4ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.517729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573c30-71f8-4997-b6f6-144579fc4ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.520184 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573c30-71f8-4997-b6f6-144579fc4ad5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.540611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaa0ca-2a8a-4a57-82d0-6406a9ca5959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.541932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaa0ca-2a8a-4a57-82d0-6406a9ca5959 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.542378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaa0ca-2a8a-4a57-82d0-6406a9ca5959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.542720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaa0ca-2a8a-4a57-82d0-6406a9ca5959 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.543803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaa0ca-2a8a-4a57-82d0-6406a9ca5959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.548113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaa0ca-2a8a-4a57-82d0-6406a9ca5959 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.554673 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 787/1582] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.554673 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573c30-71f8-4997-b6f6-144579fc4ad5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.563859 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573c30-71f8-4997-b6f6-144579fc4ad5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.572948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00410373-e47c-4ec9-9003-e0127281575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.573671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00410373-e47c-4ec9-9003-e0127281575d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.573956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00410373-e47c-4ec9-9003-e0127281575d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.574270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00410373-e47c-4ec9-9003-e0127281575d admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.575011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00410373-e47c-4ec9-9003-e0127281575d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.577370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00410373-e47c-4ec9-9003-e0127281575d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.589822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 796/1583] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/projects => generated 389 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.591173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaa0ca-2a8a-4a57-82d0-6406a9ca5959 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.614372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 788/1584] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/users => generated 285 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.615138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00410373-e47c-4ec9-9003-e0127281575d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.629225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00410373-e47c-4ec9-9003-e0127281575d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.652519 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:59.678330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaa0ca-2a8a-4a57-82d0-6406a9ca5959 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.684667 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e830-b504-4370-b407-b9eb348d0090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.686041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e830-b504-4370-b407-b9eb348d0090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.686361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e830-b504-4370-b407-b9eb348d0090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.686809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e830-b504-4370-b407-b9eb348d0090 admin admin] PATH_INFO: `/v3/projects/17ea6f9d80f345dbb3b2bf75e0138fd3/users/b75243e37f2342c0a428d39e193e0d4b/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.696001 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c35f2-60ff-4778-8b96-cfc5e76c1ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.696706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c35f2-60ff-4778-8b96-cfc5e76c1ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.696994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c35f2-60ff-4778-8b96-cfc5e76c1ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.697271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c35f2-60ff-4778-8b96-cfc5e76c1ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.698013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c35f2-60ff-4778-8b96-cfc5e76c1ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.699849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c35f2-60ff-4778-8b96-cfc5e76c1ae7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.707424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541e830-b504-4370-b407-b9eb348d0090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ea6f9d80f345dbb3b2bf75e0138fd3, user_id=b75243e37f2342c0a428d39e193e0d4b, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.710156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541e830-b504-4370-b407-b9eb348d0090 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.715864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 789/1585] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:56:59.716806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c35f2-60ff-4778-8b96-cfc5e76c1ae7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.728217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c35f2-60ff-4778-8b96-cfc5e76c1ae7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.729693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 797/1586] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:56:59 2022] PUT /identity/v3/projects/17ea6f9d80f345dbb3b2bf75e0138fd3/users/b75243e37f2342c0a428d39e193e0d4b/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:56:59.730895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e830-b504-4370-b407-b9eb348d0090 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.759663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:56:59.799785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bedf0-411e-4ebf-80af-faec57afb9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.800857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bedf0-411e-4ebf-80af-faec57afb9eb admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.801272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bedf0-411e-4ebf-80af-faec57afb9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.801726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bedf0-411e-4ebf-80af-faec57afb9eb admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.802932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bedf0-411e-4ebf-80af-faec57afb9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.806216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bedf0-411e-4ebf-80af-faec57afb9eb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.809011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e830-b504-4370-b407-b9eb348d0090 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.815894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cbd27-8156-4e9e-acfc-e17a98a23b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.817239 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cbd27-8156-4e9e-acfc-e17a98a23b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.817699 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cbd27-8156-4e9e-acfc-e17a98a23b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.818114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cbd27-8156-4e9e-acfc-e17a98a23b3b admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.819315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cbd27-8156-4e9e-acfc-e17a98a23b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.822671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cbd27-8156-4e9e-acfc-e17a98a23b3b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.835496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 790/1587] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.839754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bedf0-411e-4ebf-80af-faec57afb9eb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.848253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 798/1588] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.849089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cbd27-8156-4e9e-acfc-e17a98a23b3b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.850854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bedf0-411e-4ebf-80af-faec57afb9eb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.856828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05e79f-989d-4487-b153-286a095b370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.857544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05e79f-989d-4487-b153-286a095b370b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.857821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05e79f-989d-4487-b153-286a095b370b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.858105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05e79f-989d-4487-b153-286a095b370b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.859408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05e79f-989d-4487-b153-286a095b370b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.860643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05e79f-989d-4487-b153-286a095b370b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.860933 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cbd27-8156-4e9e-acfc-e17a98a23b3b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.866261 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bc358-4c0c-4a9b-bb96-272223e46c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.867126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bc358-4c0c-4a9b-bb96-272223e46c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.867515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bc358-4c0c-4a9b-bb96-272223e46c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.867864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bc358-4c0c-4a9b-bb96-272223e46c96 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.868662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bc358-4c0c-4a9b-bb96-272223e46c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.870682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bc358-4c0c-4a9b-bb96-272223e46c96 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.872977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 791/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:56:59.874241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05e79f-989d-4487-b153-286a095b370b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.884893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05e79f-989d-4487-b153-286a095b370b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.890081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f1ee3-230e-4d12-a81d-1a53ca394939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.890814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f1ee3-230e-4d12-a81d-1a53ca394939 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.891168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f1ee3-230e-4d12-a81d-1a53ca394939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.891512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f1ee3-230e-4d12-a81d-1a53ca394939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.892288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f1ee3-230e-4d12-a81d-1a53ca394939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.894212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f1ee3-230e-4d12-a81d-1a53ca394939 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.906386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 799/1590] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/users => generated 295 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:56:59.907163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bc358-4c0c-4a9b-bb96-272223e46c96 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.914735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 792/1591] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:56:59.916962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed156b-550a-44c1-b79a-5fbe60e2e3a0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.917369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed156b-550a-44c1-b79a-5fbe60e2e3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.918024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bc358-4c0c-4a9b-bb96-272223e46c96 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:56:59.918281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed156b-550a-44c1-b79a-5fbe60e2e3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.923953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84512d9-655f-423a-98f3-589185b3d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:56:59.925304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84512d9-655f-423a-98f3-589185b3d854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:56:59.925614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84512d9-655f-423a-98f3-589185b3d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:56:59.925920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84512d9-655f-423a-98f3-589185b3d854 admin admin] PATH_INFO: `/v3/projects/13a3f9864ad04941bc902febad84876d/users/8bfbd9324f8040c496a83eb599ca80c0/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:56:59.942234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84512d9-655f-423a-98f3-589185b3d854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a3f9864ad04941bc902febad84876d, user_id=8bfbd9324f8040c496a83eb599ca80c0, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:56:59.943013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-afed156b-550a-44c1-b79a-5fbe60e2e3a0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:56:59.945054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84512d9-655f-423a-98f3-589185b3d854 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:56:59.945289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afed156b-550a-44c1-b79a-5fbe60e2e3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:56:59.962270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 793/1592] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:56:59.962270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed156b-550a-44c1-b79a-5fbe60e2e3a0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.962586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 800/1593] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:56:59 2022] PUT /identity/v3/projects/13a3f9864ad04941bc902febad84876d/users/8bfbd9324f8040c496a83eb599ca80c0/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:56:59.962586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84512d9-655f-423a-98f3-589185b3d854 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:56:59.974786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed156b-550a-44c1-b79a-5fbe60e2e3a0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.050695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84512d9-655f-423a-98f3-589185b3d854 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.059547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a3356-e4a6-4f91-a757-bf99cac917bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.059977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871a73-b7a1-4eec-b047-eadbb32564b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.060697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871a73-b7a1-4eec-b047-eadbb32564b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.060846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3356-e4a6-4f91-a757-bf99cac917bf admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.060964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871a73-b7a1-4eec-b047-eadbb32564b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.061204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3356-e4a6-4f91-a757-bf99cac917bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.061351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56871a73-b7a1-4eec-b047-eadbb32564b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.062125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871a73-b7a1-4eec-b047-eadbb32564b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.062953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3356-e4a6-4f91-a757-bf99cac917bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.063986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56871a73-b7a1-4eec-b047-eadbb32564b3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.064251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a3356-e4a6-4f91-a757-bf99cac917bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.067414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a3356-e4a6-4f91-a757-bf99cac917bf admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.078141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 794/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:00.078141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871a73-b7a1-4eec-b047-eadbb32564b3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.083326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 801/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:00.084220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a3356-e4a6-4f91-a757-bf99cac917bf admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.093885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56871a73-b7a1-4eec-b047-eadbb32564b3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.095450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a3356-e4a6-4f91-a757-bf99cac917bf admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.100867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19fbe5-45ba-40eb-8bf4-8fd507fe18f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.101207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07645-741f-4ad9-962f-5c260a507807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.101734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19fbe5-45ba-40eb-8bf4-8fd507fe18f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.101922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07645-741f-4ad9-962f-5c260a507807 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.102068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19fbe5-45ba-40eb-8bf4-8fd507fe18f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.102263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07645-741f-4ad9-962f-5c260a507807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.102419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19fbe5-45ba-40eb-8bf4-8fd507fe18f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.102573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07645-741f-4ad9-962f-5c260a507807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.103105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07645-741f-4ad9-962f-5c260a507807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.103267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19fbe5-45ba-40eb-8bf4-8fd507fe18f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.104799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07645-741f-4ad9-962f-5c260a507807 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.105001 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19fbe5-45ba-40eb-8bf4-8fd507fe18f8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.108046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:00.119209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 802/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:00.121106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 795/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:00.122996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07645-741f-4ad9-962f-5c260a507807 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.123225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbbd6f-7686-45aa-88a4-1856a74565b1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.124368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbbd6f-7686-45aa-88a4-1856a74565b1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.124563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbbd6f-7686-45aa-88a4-1856a74565b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.134897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07645-741f-4ad9-962f-5c260a507807 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.141565 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeca693-3d0c-4ae4-9839-12072c6d97d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.142320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeca693-3d0c-4ae4-9839-12072c6d97d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.142604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeca693-3d0c-4ae4-9839-12072c6d97d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.142883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeca693-3d0c-4ae4-9839-12072c6d97d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.143626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeca693-3d0c-4ae4-9839-12072c6d97d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.145315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeca693-3d0c-4ae4-9839-12072c6d97d9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.147989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-94dbbd6f-7686-45aa-88a4-1856a74565b1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:00.149281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-94dbbd6f-7686-45aa-88a4-1856a74565b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:00.158155 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 803/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:00.162829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 796/1599] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:00.162829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbbd6f-7686-45aa-88a4-1856a74565b1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.163927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeca693-3d0c-4ae4-9839-12072c6d97d9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.166227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cfeca693-3d0c-4ae4-9839-12072c6d97d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:00.173546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbbd6f-7686-45aa-88a4-1856a74565b1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.178999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ea5ef-9779-4e5d-a54f-5018eddb3a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.179709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ea5ef-9779-4e5d-a54f-5018eddb3a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.179996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ea5ef-9779-4e5d-a54f-5018eddb3a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.180305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ea5ef-9779-4e5d-a54f-5018eddb3a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.181061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ea5ef-9779-4e5d-a54f-5018eddb3a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.182798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ea5ef-9779-4e5d-a54f-5018eddb3a4f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.194883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 797/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:00.195770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ea5ef-9779-4e5d-a54f-5018eddb3a4f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.206640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ea5ef-9779-4e5d-a54f-5018eddb3a4f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.212077 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450b65f-3f6e-47da-9185-8ae5888c7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.213638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450b65f-3f6e-47da-9185-8ae5888c7a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.213956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450b65f-3f6e-47da-9185-8ae5888c7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.214302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450b65f-3f6e-47da-9185-8ae5888c7a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.215067 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450b65f-3f6e-47da-9185-8ae5888c7a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.217416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450b65f-3f6e-47da-9185-8ae5888c7a31 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.231773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 798/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:00.231773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450b65f-3f6e-47da-9185-8ae5888c7a31 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.241394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450b65f-3f6e-47da-9185-8ae5888c7a31 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.250981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b0572-7e40-40ff-ac2f-0e3824c271ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.251699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b0572-7e40-40ff-ac2f-0e3824c271ab admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.251987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b0572-7e40-40ff-ac2f-0e3824c271ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.252265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b0572-7e40-40ff-ac2f-0e3824c271ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.252989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b0572-7e40-40ff-ac2f-0e3824c271ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.253116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeca693-3d0c-4ae4-9839-12072c6d97d9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.254703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b0572-7e40-40ff-ac2f-0e3824c271ab admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.258704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a81508-811f-4689-acce-2126a611605e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.260047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a81508-811f-4689-acce-2126a611605e service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.260755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a81508-811f-4689-acce-2126a611605e service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.261259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a81508-811f-4689-acce-2126a611605e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.266965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 799/1602] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:00.266965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b0572-7e40-40ff-ac2f-0e3824c271ab admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.278172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b0572-7e40-40ff-ac2f-0e3824c271ab admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.278499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a81508-811f-4689-acce-2126a611605e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.282442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a81508-811f-4689-acce-2126a611605e service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.283704 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce5bc7-786d-4a4a-97ef-2f323c1cfba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.284670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce5bc7-786d-4a4a-97ef-2f323c1cfba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.284953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce5bc7-786d-4a4a-97ef-2f323c1cfba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.285228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce5bc7-786d-4a4a-97ef-2f323c1cfba8 admin admin] PATH_INFO: `/v3/projects/4c048fb2cf4e491980fb65a8e32b0fb2/users/e2d0edf9b51d4370950f7ff503c324b8/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.301470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce5bc7-786d-4a4a-97ef-2f323c1cfba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c048fb2cf4e491980fb65a8e32b0fb2, user_id=e2d0edf9b51d4370950f7ff503c324b8, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.301775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 804/1603] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:00.303048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a81508-811f-4689-acce-2126a611605e service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.304506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce5bc7-786d-4a4a-97ef-2f323c1cfba8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.318417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a81508-811f-4689-acce-2126a611605e service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.321309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 800/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:00 2022] PUT /identity/v3/projects/4c048fb2cf4e491980fb65a8e32b0fb2/users/e2d0edf9b51d4370950f7ff503c324b8/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:00.323209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce5bc7-786d-4a4a-97ef-2f323c1cfba8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.336495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:00.400119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7605aa-970f-4ca9-9471-5fcc9deb19a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.400725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7605aa-970f-4ca9-9471-5fcc9deb19a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.401017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7605aa-970f-4ca9-9471-5fcc9deb19a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.401297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7605aa-970f-4ca9-9471-5fcc9deb19a9 admin admin] PATH_INFO: `/v3/projects/8fcf2fbd2d714c60a0512acd8c3ffc05/users/31ce9ef64779422994d3bbdc76506921/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.404946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce5bc7-786d-4a4a-97ef-2f323c1cfba8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.409601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166b277-96b9-4503-8025-3e7f06f81f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.410547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b277-96b9-4503-8025-3e7f06f81f2e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.410917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b277-96b9-4503-8025-3e7f06f81f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.411263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b277-96b9-4503-8025-3e7f06f81f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.425731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166b277-96b9-4503-8025-3e7f06f81f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.426975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7605aa-970f-4ca9-9471-5fcc9deb19a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcf2fbd2d714c60a0512acd8c3ffc05, user_id=31ce9ef64779422994d3bbdc76506921, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.428122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166b277-96b9-4503-8025-3e7f06f81f2e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.431291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7605aa-970f-4ca9-9471-5fcc9deb19a9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.445369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 801/1605] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:00.446575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166b277-96b9-4503-8025-3e7f06f81f2e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.450538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 805/1606] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:00 2022] PUT /identity/v3/projects/8fcf2fbd2d714c60a0512acd8c3ffc05/users/31ce9ef64779422994d3bbdc76506921/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:00.451628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7605aa-970f-4ca9-9471-5fcc9deb19a9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.458515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166b277-96b9-4503-8025-3e7f06f81f2e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.542669 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c3089-b328-49c8-b6a6-f2b818ad34f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.543818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c3089-b328-49c8-b6a6-f2b818ad34f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.544355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c3089-b328-49c8-b6a6-f2b818ad34f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.544716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c3089-b328-49c8-b6a6-f2b818ad34f3 admin admin] PATH_INFO: `/v3/projects/23012b91a3274aef98d6e17feab67a02/users/165eda88af394c35bcd7e30534fb9c71/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.548494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7605aa-970f-4ca9-9471-5fcc9deb19a9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.555471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8abb-6db4-45ec-b39d-6263eb65aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.556754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8abb-6db4-45ec-b39d-6263eb65aa37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.557797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8abb-6db4-45ec-b39d-6263eb65aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.558232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8abb-6db4-45ec-b39d-6263eb65aa37 admin admin] PATH_INFO: `/v3/projects/63a7cbf275cc46bcb1885ced17b76d0a/users/2be9f446b10d4ead8066ccf44fb3613f/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.568089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c3089-b328-49c8-b6a6-f2b818ad34f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23012b91a3274aef98d6e17feab67a02, user_id=165eda88af394c35bcd7e30534fb9c71, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.571845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c3089-b328-49c8-b6a6-f2b818ad34f3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.582217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8abb-6db4-45ec-b39d-6263eb65aa37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a7cbf275cc46bcb1885ced17b76d0a, user_id=2be9f446b10d4ead8066ccf44fb3613f, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.585544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8abb-6db4-45ec-b39d-6263eb65aa37 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.590614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:00.593281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 802/1607] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:00 2022] PUT /identity/v3/projects/23012b91a3274aef98d6e17feab67a02/users/165eda88af394c35bcd7e30534fb9c71/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:00.594188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c3089-b328-49c8-b6a6-f2b818ad34f3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:00.623017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 806/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:00 2022] PUT /identity/v3/projects/63a7cbf275cc46bcb1885ced17b76d0a/users/2be9f446b10d4ead8066ccf44fb3613f/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:00.624652 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a0206-971e-48e8-9ff7-b0cad1d64ff4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.625116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a0206-971e-48e8-9ff7-b0cad1d64ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.625461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a0206-971e-48e8-9ff7-b0cad1d64ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.676476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a61a0206-971e-48e8-9ff7-b0cad1d64ff4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:00.678991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a61a0206-971e-48e8-9ff7-b0cad1d64ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:00.693921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c3089-b328-49c8-b6a6-f2b818ad34f3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:00.777991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:00.806694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 807/1609] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:00.808080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03ff96-5227-4cca-93cf-58110721418e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.808378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03ff96-5227-4cca-93cf-58110721418e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.808709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03ff96-5227-4cca-93cf-58110721418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.814956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfffea9-c910-458a-a07a-ef5b245dd533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:00.816060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfffea9-c910-458a-a07a-ef5b245dd533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.816415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfffea9-c910-458a-a07a-ef5b245dd533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.816754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfffea9-c910-458a-a07a-ef5b245dd533 admin admin] PATH_INFO: `/v3/projects/c777f8f104af4d37a3b89ff9a57d2218/users/847c39439e874e68b72e07c311a53bec/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.837002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfffea9-c910-458a-a07a-ef5b245dd533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c777f8f104af4d37a3b89ff9a57d2218, user_id=847c39439e874e68b72e07c311a53bec, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:00.840813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfffea9-c910-458a-a07a-ef5b245dd533 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:00.844022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-aa03ff96-5227-4cca-93cf-58110721418e None None] MFA Rules not processed for user `31ce9ef64779422994d3bbdc76506921`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:00.846274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-aa03ff96-5227-4cca-93cf-58110721418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:00.861294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 803/1610] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:00 2022] PUT /identity/v3/projects/c777f8f104af4d37a3b89ff9a57d2218/users/847c39439e874e68b72e07c311a53bec/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:00.863206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077635c-5cbf-42ff-b2bc-beb4d2b282b7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.863572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077635c-5cbf-42ff-b2bc-beb4d2b282b7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.863982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077635c-5cbf-42ff-b2bc-beb4d2b282b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.900475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2077635c-5cbf-42ff-b2bc-beb4d2b282b7 None None] MFA Rules not processed for user `165eda88af394c35bcd7e30534fb9c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:00.901931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2077635c-5cbf-42ff-b2bc-beb4d2b282b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:00.937039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 808/1611] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:00.939148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422b8b4-f52d-4d75-836f-90e50c68d5f6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:00.939148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422b8b4-f52d-4d75-836f-90e50c68d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:00.939491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422b8b4-f52d-4d75-836f-90e50c68d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:00.974659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2422b8b4-f52d-4d75-836f-90e50c68d5f6 None None] MFA Rules not processed for user `2be9f446b10d4ead8066ccf44fb3613f`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:00.975990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2422b8b4-f52d-4d75-836f-90e50c68d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:01.152640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 809/1612] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:01.152640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422b8b4-f52d-4d75-836f-90e50c68d5f6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:01.155498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 804/1613] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:01.169209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e1dd-ac2c-4ef0-b0ec-eacf9c7da5d6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.169451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e1dd-ac2c-4ef0-b0ec-eacf9c7da5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.169683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e1dd-ac2c-4ef0-b0ec-eacf9c7da5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.173755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:01.230042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8f19e1dd-ac2c-4ef0-b0ec-eacf9c7da5d6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:01.231346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8f19e1dd-ac2c-4ef0-b0ec-eacf9c7da5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:01.250729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422b8b4-f52d-4d75-836f-90e50c68d5f6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:01.257121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7848cd-3931-48d4-84f8-d8dab67f1ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:01.258358 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7848cd-3931-48d4-84f8-d8dab67f1ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.258936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7848cd-3931-48d4-84f8-d8dab67f1ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.259512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7848cd-3931-48d4-84f8-d8dab67f1ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.352795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 805/1614] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:01.353975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e1dd-ac2c-4ef0-b0ec-eacf9c7da5d6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:01.365202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7848cd-3931-48d4-84f8-d8dab67f1ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:01.367270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e1dd-ac2c-4ef0-b0ec-eacf9c7da5d6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:01.368293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7848cd-3931-48d4-84f8-d8dab67f1ee4 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:01.376048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ac5e2-d8ec-477d-95a8-c49334e00879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:01.377298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ac5e2-d8ec-477d-95a8-c49334e00879 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.378463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ac5e2-d8ec-477d-95a8-c49334e00879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.378987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ac5e2-d8ec-477d-95a8-c49334e00879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.380363 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ac5e2-d8ec-477d-95a8-c49334e00879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:01.390467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ac5e2-d8ec-477d-95a8-c49334e00879 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:01.419445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 810/1615] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:01.421266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7848cd-3931-48d4-84f8-d8dab67f1ee4 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:01.434438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 806/1616] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:01 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:01.436081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7848cd-3931-48d4-84f8-d8dab67f1ee4 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:01.436212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cee74b-e282-406e-b8b4-3fbc118a5cbf None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.436823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cee74b-e282-406e-b8b4-3fbc118a5cbf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.437309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cee74b-e282-406e-b8b4-3fbc118a5cbf None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.439236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 807/1617] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 17 12:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:57:01.440145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cee74b-e282-406e-b8b4-3fbc118a5cbf None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:01.499840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:01.534460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b231c-4975-4c13-8723-ac53c334b7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:01.535187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b231c-4975-4c13-8723-ac53c334b7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.535460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b231c-4975-4c13-8723-ac53c334b7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.535737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b231c-4975-4c13-8723-ac53c334b7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.536452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b231c-4975-4c13-8723-ac53c334b7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:01.538608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b231c-4975-4c13-8723-ac53c334b7eb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:01.538922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cee74b-e282-406e-b8b4-3fbc118a5cbf None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:01.544937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811425b9-fb58-403e-a7a5-ed7b0bf3569c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:01.547307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811425b9-fb58-403e-a7a5-ed7b0bf3569c service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.547956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811425b9-fb58-403e-a7a5-ed7b0bf3569c service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.548621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811425b9-fb58-403e-a7a5-ed7b0bf3569c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.564891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811425b9-fb58-403e-a7a5-ed7b0bf3569c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:01.567408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811425b9-fb58-403e-a7a5-ed7b0bf3569c service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:01.591665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 808/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:01.592856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811425b9-fb58-403e-a7a5-ed7b0bf3569c service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:01.596032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 811/1619] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:01 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:01.597415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84d99-7cad-4595-a70c-41de3a149920 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.597705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84d99-7cad-4595-a70c-41de3a149920 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.597983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84d99-7cad-4595-a70c-41de3a149920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.607990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811425b9-fb58-403e-a7a5-ed7b0bf3569c service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:01.643396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4cb84d99-7cad-4595-a70c-41de3a149920 None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:01.645322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4cb84d99-7cad-4595-a70c-41de3a149920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:01.707921 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:01.719618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b7ac5-f47b-4cef-9c2d-0bfbf17aa917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:01.721345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b7ac5-f47b-4cef-9c2d-0bfbf17aa917 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.721775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b7ac5-f47b-4cef-9c2d-0bfbf17aa917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.722411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b7ac5-f47b-4cef-9c2d-0bfbf17aa917 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.723306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b7ac5-f47b-4cef-9c2d-0bfbf17aa917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:01.725947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b7ac5-f47b-4cef-9c2d-0bfbf17aa917 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:01.737451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 812/1620] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 17 12:57:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:01.738502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84d99-7cad-4595-a70c-41de3a149920 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:01.752352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb84d99-7cad-4595-a70c-41de3a149920 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:01.758801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcbdff-7826-405c-9270-d09422ee9a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:01.759669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcbdff-7826-405c-9270-d09422ee9a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.760501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcbdff-7826-405c-9270-d09422ee9a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.761017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcbdff-7826-405c-9270-d09422ee9a6e admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.761840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcbdff-7826-405c-9270-d09422ee9a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:01.765821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcbdff-7826-405c-9270-d09422ee9a6e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:01.806980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 809/1621] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:01 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:01.807136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 813/1622] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:01 2022] POST /identity/v3/users => generated 299 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:01.807136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcbdff-7826-405c-9270-d09422ee9a6e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:01.807516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b7ac5-f47b-4cef-9c2d-0bfbf17aa917 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:01.838064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcbdff-7826-405c-9270-d09422ee9a6e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:01.842204 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b7ac5-f47b-4cef-9c2d-0bfbf17aa917 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:01.850633 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70a8d-57a4-4841-9c4f-6125ea612a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:01.852941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70a8d-57a4-4841-9c4f-6125ea612a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.853960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70a8d-57a4-4841-9c4f-6125ea612a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.854993 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70a8d-57a4-4841-9c4f-6125ea612a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.859271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba70a8d-57a4-4841-9c4f-6125ea612a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:01.860933 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba70a8d-57a4-4841-9c4f-6125ea612a8d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:01.861774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0d1f3-a33b-4db9-bd2e-e0387f040eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:01.862604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0d1f3-a33b-4db9-bd2e-e0387f040eab service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.863012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0d1f3-a33b-4db9-bd2e-e0387f040eab service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.863377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0d1f3-a33b-4db9-bd2e-e0387f040eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.894165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 814/1623] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:01.897647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70a8d-57a4-4841-9c4f-6125ea612a8d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:01.923792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70a8d-57a4-4841-9c4f-6125ea612a8d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:01.940618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7faad0-1cf3-4284-96d0-6e61472ac2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:01.941860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7faad0-1cf3-4284-96d0-6e61472ac2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:01.942297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7faad0-1cf3-4284-96d0-6e61472ac2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:01.942678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7faad0-1cf3-4284-96d0-6e61472ac2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:01.943910 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7faad0-1cf3-4284-96d0-6e61472ac2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:01.958129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7faad0-1cf3-4284-96d0-6e61472ac2cb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:02.004808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 815/1624] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:02.005964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7faad0-1cf3-4284-96d0-6e61472ac2cb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:02.017934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0d1f3-a33b-4db9-bd2e-e0387f040eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:02.020292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0d1f3-a33b-4db9-bd2e-e0387f040eab service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:02.038575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 810/1625] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:02.041292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7faad0-1cf3-4284-96d0-6e61472ac2cb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:02.042545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0d1f3-a33b-4db9-bd2e-e0387f040eab service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:02.064015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1a304-3537-4b01-899d-b7fdd9e1abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:02.065135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1a304-3537-4b01-899d-b7fdd9e1abad admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.065528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1a304-3537-4b01-899d-b7fdd9e1abad admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.065900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1a304-3537-4b01-899d-b7fdd9e1abad admin admin] PATH_INFO: `/v3/projects/10543c7254854a2fbe137037ab2b7950/users/073b44c796034aff810c02ee0f255c22/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.074512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0d1f3-a33b-4db9-bd2e-e0387f040eab service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:02.089232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931ec20-91a0-4ea1-99bf-b109df528238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:02.090367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931ec20-91a0-4ea1-99bf-b109df528238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.090754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931ec20-91a0-4ea1-99bf-b109df528238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.091137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931ec20-91a0-4ea1-99bf-b109df528238 admin admin] PATH_INFO: `/v3/projects/a6afdcd9d1fb400197e51ccaa059eef6/users/fdf96fee9160462a942e7bd4f8e7c0b1/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.103620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1a304-3537-4b01-899d-b7fdd9e1abad admin admin] RBAC: Authorizing `identity:create_grant(project_id=10543c7254854a2fbe137037ab2b7950, user_id=073b44c796034aff810c02ee0f255c22, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:02.111060 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1a304-3537-4b01-899d-b7fdd9e1abad admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:02.125932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931ec20-91a0-4ea1-99bf-b109df528238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6afdcd9d1fb400197e51ccaa059eef6, user_id=fdf96fee9160462a942e7bd4f8e7c0b1, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:02.136028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931ec20-91a0-4ea1-99bf-b109df528238 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:02.143805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 816/1626] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:02 2022] PUT /identity/v3/projects/10543c7254854a2fbe137037ab2b7950/users/073b44c796034aff810c02ee0f255c22/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:02.146157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1a304-3537-4b01-899d-b7fdd9e1abad admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:02.182867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 811/1627] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:02 2022] PUT /identity/v3/projects/a6afdcd9d1fb400197e51ccaa059eef6/users/fdf96fee9160462a942e7bd4f8e7c0b1/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:02.186990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931ec20-91a0-4ea1-99bf-b109df528238 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:02.275324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1a304-3537-4b01-899d-b7fdd9e1abad admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:02.292393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:02.342172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931ec20-91a0-4ea1-99bf-b109df528238 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:02.347417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d4aac-870c-4de4-a5c0-ce7d8c1bb42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:02.348296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d4aac-870c-4de4-a5c0-ce7d8c1bb42d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.348681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d4aac-870c-4de4-a5c0-ce7d8c1bb42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.349054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d4aac-870c-4de4-a5c0-ce7d8c1bb42d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.349911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d4aac-870c-4de4-a5c0-ce7d8c1bb42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:02.351740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d4aac-870c-4de4-a5c0-ce7d8c1bb42d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:02.357124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1009-a3ad-44ec-9c22-377cb1d892b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:02.358462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1009-a3ad-44ec-9c22-377cb1d892b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.361159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1009-a3ad-44ec-9c22-377cb1d892b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.361960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d1009-a3ad-44ec-9c22-377cb1d892b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.364463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 817/1628] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:02.365663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d1009-a3ad-44ec-9c22-377cb1d892b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:02.371234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d4aac-870c-4de4-a5c0-ce7d8c1bb42d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:02.374879 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d1009-a3ad-44ec-9c22-377cb1d892b3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:02.397036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d4aac-870c-4de4-a5c0-ce7d8c1bb42d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:02.405658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a0c18-30ab-4c8e-996a-cde5955ff49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:02.407466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a0c18-30ab-4c8e-996a-cde5955ff49c admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.407855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a0c18-30ab-4c8e-996a-cde5955ff49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.408240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a0c18-30ab-4c8e-996a-cde5955ff49c admin admin] PATH_INFO: `/v3/projects/10543c7254854a2fbe137037ab2b7950/users/073b44c796034aff810c02ee0f255c22/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.411563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 812/1629] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:02.412928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a0c18-30ab-4c8e-996a-cde5955ff49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=10543c7254854a2fbe137037ab2b7950, user_id=073b44c796034aff810c02ee0f255c22, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:02.413511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1009-a3ad-44ec-9c22-377cb1d892b3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:02.418649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a0c18-30ab-4c8e-996a-cde5955ff49c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:02.439036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d1009-a3ad-44ec-9c22-377cb1d892b3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:02.445169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 818/1630] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:02 2022] PUT /identity/v3/projects/10543c7254854a2fbe137037ab2b7950/users/073b44c796034aff810c02ee0f255c22/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:02.457782 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a68dd-a854-4bf3-9e2e-aea641b2bcc5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.458260 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a68dd-a854-4bf3-9e2e-aea641b2bcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.458792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a68dd-a854-4bf3-9e2e-aea641b2bcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.506180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:02.528673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f59a68dd-a854-4bf3-9e2e-aea641b2bcc5 None None] MFA Rules not processed for user `073b44c796034aff810c02ee0f255c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:02.530014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f59a68dd-a854-4bf3-9e2e-aea641b2bcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:02.636869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93329943-ece9-4aef-b780-93fe2b77aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:02.637960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93329943-ece9-4aef-b780-93fe2b77aa02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.638407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93329943-ece9-4aef-b780-93fe2b77aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.638753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93329943-ece9-4aef-b780-93fe2b77aa02 admin admin] PATH_INFO: `/v3/projects/a6afdcd9d1fb400197e51ccaa059eef6/users/fdf96fee9160462a942e7bd4f8e7c0b1/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.641757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93329943-ece9-4aef-b780-93fe2b77aa02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6afdcd9d1fb400197e51ccaa059eef6, user_id=fdf96fee9160462a942e7bd4f8e7c0b1, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:02.644827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93329943-ece9-4aef-b780-93fe2b77aa02 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:02.666355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 813/1631] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:02 2022] PUT /identity/v3/projects/a6afdcd9d1fb400197e51ccaa059eef6/users/fdf96fee9160462a942e7bd4f8e7c0b1/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:02.668277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d2d5a-d645-4ebe-9a6d-9640a3740982 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.668680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d2d5a-d645-4ebe-9a6d-9640a3740982 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.669057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d2d5a-d645-4ebe-9a6d-9640a3740982 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.670900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 814/1632] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 17 12:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:57:02.679672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffa925-ebdc-4c20-8de7-bd0e497b25bd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.680109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffa925-ebdc-4c20-8de7-bd0e497b25bd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.680851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffa925-ebdc-4c20-8de7-bd0e497b25bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.693008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 819/1633] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:02.695986 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e782a-86d0-4439-ad8c-fdf1516b68bd None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.696491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e782a-86d0-4439-ad8c-fdf1516b68bd None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.696904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e782a-86d0-4439-ad8c-fdf1516b68bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.720982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-671e782a-86d0-4439-ad8c-fdf1516b68bd None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:02.722546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-671e782a-86d0-4439-ad8c-fdf1516b68bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:02.771910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-25ffa925-ebdc-4c20-8de7-bd0e497b25bd None None] MFA Rules not processed for user `fdf96fee9160462a942e7bd4f8e7c0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:02.775555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-25ffa925-ebdc-4c20-8de7-bd0e497b25bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:02.818771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 820/1634] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 17 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:02.820647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138ec6-4434-4179-92b7-283e3730654b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.821794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138ec6-4434-4179-92b7-283e3730654b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.822279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138ec6-4434-4179-92b7-283e3730654b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.824644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 821/1635] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 17 12:57:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:57:02.825947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86138ec6-4434-4179-92b7-283e3730654b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:02.932644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86138ec6-4434-4179-92b7-283e3730654b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:02.936812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e88e3-4b0a-42a8-b4aa-e2000752cf65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:02.937517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e88e3-4b0a-42a8-b4aa-e2000752cf65 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.937792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e88e3-4b0a-42a8-b4aa-e2000752cf65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.938074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e88e3-4b0a-42a8-b4aa-e2000752cf65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.964521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 815/1636] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:02.966368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0c8b0-3c6b-436f-bd04-6b6e4e9c665e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.966871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0c8b0-3c6b-436f-bd04-6b6e4e9c665e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.967317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0c8b0-3c6b-436f-bd04-6b6e4e9c665e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.971963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 816/1637] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 17 12:57:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:57:02.976375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a69af-7d50-4aab-be63-46b491f8668b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:02.977726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a69af-7d50-4aab-be63-46b491f8668b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:02.979509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a69af-7d50-4aab-be63-46b491f8668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:02.998123 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:03.029304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e88e3-4b0a-42a8-b4aa-e2000752cf65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:03.031698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e88e3-4b0a-42a8-b4aa-e2000752cf65 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:03.037721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-871a69af-7d50-4aab-be63-46b491f8668b None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:03.039255 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-871a69af-7d50-4aab-be63-46b491f8668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:03.045619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 822/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:03.047384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0bbe-e613-4fd6-9ceb-55bb2bf19e00 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:03.047759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0bbe-e613-4fd6-9ceb-55bb2bf19e00 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:03.048111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0bbe-e613-4fd6-9ceb-55bb2bf19e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:03.069906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-892d0bbe-e613-4fd6-9ceb-55bb2bf19e00 None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:03.071507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-892d0bbe-e613-4fd6-9ceb-55bb2bf19e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:03.076575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 817/1639] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:03.077714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a69af-7d50-4aab-be63-46b491f8668b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:03.098519 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 823/1640] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 12:57:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:03.102392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a69af-7d50-4aab-be63-46b491f8668b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:03.108481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d0bbe-e613-4fd6-9ceb-55bb2bf19e00 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:03.110639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014657a-f237-4a55-9b6e-82c4802aeb57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:03.111791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014657a-f237-4a55-9b6e-82c4802aeb57 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:03.112079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014657a-f237-4a55-9b6e-82c4802aeb57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:03.112501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014657a-f237-4a55-9b6e-82c4802aeb57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:03.143323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014657a-f237-4a55-9b6e-82c4802aeb57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:03.145730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014657a-f237-4a55-9b6e-82c4802aeb57 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:03.176963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 818/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:03.181058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014657a-f237-4a55-9b6e-82c4802aeb57 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:03.199706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d0bbe-e613-4fd6-9ceb-55bb2bf19e00 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:03.208390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014657a-f237-4a55-9b6e-82c4802aeb57 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:03.209507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:03.211439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:03.213541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654ba7f-0f22-482f-bf08-c431b87e62f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:03.214166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:03.214573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] PATH_INFO: `/v3/users/2be9f446b10d4ead8066ccf44fb3613f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:03.215467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654ba7f-0f22-482f-bf08-c431b87e62f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:03.215755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654ba7f-0f22-482f-bf08-c431b87e62f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:03.216034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654ba7f-0f22-482f-bf08-c431b87e62f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:03.217614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be9f446b10d4ead8066ccf44fb3613f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:03.221198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:03.232671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654ba7f-0f22-482f-bf08-c431b87e62f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:03.237156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654ba7f-0f22-482f-bf08-c431b87e62f0 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:03.256109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 819/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:03.273066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654ba7f-0f22-482f-bf08-c431b87e62f0 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:03.293611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654ba7f-0f22-482f-bf08-c431b87e62f0 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:03.305476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fedb61-5809-4aee-9beb-985352e64851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:03.306997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fedb61-5809-4aee-9beb-985352e64851 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:03.307807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fedb61-5809-4aee-9beb-985352e64851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:03.308519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fedb61-5809-4aee-9beb-985352e64851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:03.337245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fedb61-5809-4aee-9beb-985352e64851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:03.342863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fedb61-5809-4aee-9beb-985352e64851 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:03.384011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be9f446b10d4ead8066ccf44fb3613f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:03.384998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be9f446b10d4ead8066ccf44fb3613f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:03.385753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be9f446b10d4ead8066ccf44fb3613f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:03.398902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 820/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:03.403152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be9f446b10d4ead8066ccf44fb3613f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:03.415056 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be9f446b10d4ead8066ccf44fb3613f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:03.456584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 824/1644] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:03 2022] DELETE /identity/v3/users/2be9f446b10d4ead8066ccf44fb3613f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:03.464063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeee3f1-a2d3-4372-b0ff-f91668d8d66b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:03.464950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeee3f1-a2d3-4372-b0ff-f91668d8d66b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:03.465935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeee3f1-a2d3-4372-b0ff-f91668d8d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:03.557333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5aeee3f1-a2d3-4372-b0ff-f91668d8d66b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:03.573982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5aeee3f1-a2d3-4372-b0ff-f91668d8d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:03.599819 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:03.793630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 821/1645] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:03.892055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:03.893642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:03.900421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeee3f1-a2d3-4372-b0ff-f91668d8d66b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:03.902044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5aeee3f1-a2d3-4372-b0ff-f91668d8d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:03.927973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5c5f6-7bd9-4854-b13f-ff377b54e59c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:03.933319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:03.934912 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:03.934912 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:03.934912 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] PATH_INFO: `/v3/users/165eda88af394c35bcd7e30534fb9c71` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:03.941883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=165eda88af394c35bcd7e30534fb9c71)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:03.944116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:04.043779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:04.048755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165eda88af394c35bcd7e30534fb9c71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:04.052662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165eda88af394c35bcd7e30534fb9c71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:04.053583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165eda88af394c35bcd7e30534fb9c71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:04.066722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165eda88af394c35bcd7e30534fb9c71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:04.092354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-de8f4aab-b8f6-409e-9b7a-4ede72008d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165eda88af394c35bcd7e30534fb9c71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:04.100937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeee3f1-a2d3-4372-b0ff-f91668d8d66b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:04.111566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:04.111566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:04.111566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:04.111566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:04.117228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:04.132204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 825/1646] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:03 2022] DELETE /identity/v3/users/165eda88af394c35bcd7e30534fb9c71 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:04.134150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e96175-2c8b-4095-a72c-516ed5935a15 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:04.134553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e96175-2c8b-4095-a72c-516ed5935a15 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:04.134938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e96175-2c8b-4095-a72c-516ed5935a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:04.150610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:04.154158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:04.174977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-58e96175-2c8b-4095-a72c-516ed5935a15 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:04.176739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-58e96175-2c8b-4095-a72c-516ed5935a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:04.198588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 822/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:57:04.365582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 826/1648] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:04.482246 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:04.484149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:04.502754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734253ba-3542-4d6c-b910-7794a017e67e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:04.653908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2740b-8422-44a5-acc0-8329edb21768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:04.654635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2740b-8422-44a5-acc0-8329edb21768 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:04.654919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2740b-8422-44a5-acc0-8329edb21768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:04.655385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2740b-8422-44a5-acc0-8329edb21768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:04.668556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2740b-8422-44a5-acc0-8329edb21768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:04.670384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2740b-8422-44a5-acc0-8329edb21768 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:04.694143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 823/1649] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:05.719350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e96175-2c8b-4095-a72c-516ed5935a15 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:05.720947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-58e96175-2c8b-4095-a72c-516ed5935a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:05.754618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e96175-2c8b-4095-a72c-516ed5935a15 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:05.769134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:05.774643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:05.775105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:05.775423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] PATH_INFO: `/v3/projects/63a7cbf275cc46bcb1885ced17b76d0a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:05.782796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a7cbf275cc46bcb1885ced17b76d0a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:05.784280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:57:05.784280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: warnings.warn(msg) Jun 17 12:57:05.784280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: Jun 17 12:57:05.785687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:05.930753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a7cbf275cc46bcb1885ced17b76d0a', 'request_id': 'req-8b40c23a-7721-4612-a306-d85839d36667'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:05.992810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a7cbf275cc46bcb1885ced17b76d0a', 'request_id': 'req-8b40c23a-7721-4612-a306-d85839d36667'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:06.007180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a7cbf275cc46bcb1885ced17b76d0a', 'request_id': 'req-8b40c23a-7721-4612-a306-d85839d36667'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:06.035974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] The token cache is being invalidate because project 63a7cbf275cc46bcb1885ced17b76d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:06.036356 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:06.037201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:06.043511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 827/1650] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:05 2022] DELETE /identity/v3/projects/63a7cbf275cc46bcb1885ced17b76d0a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:06.050927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2740b-8422-44a5-acc0-8329edb21768 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:06.094151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2740b-8422-44a5-acc0-8329edb21768 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:06.217664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:06.236554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:06.238411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:06.238895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:06.242291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] PATH_INFO: `/v3/users/073b44c796034aff810c02ee0f255c22` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:06.250937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073b44c796034aff810c02ee0f255c22)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:06.254590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 12:57:06.254590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: warnings.warn(msg) Jun 17 12:57:06.254590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: Jun 17 12:57:06.257693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:06.497861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073b44c796034aff810c02ee0f255c22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:06.571119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:06.572695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:06.624345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c23a-7721-4612-a306-d85839d36667 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:06.662452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073b44c796034aff810c02ee0f255c22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:06.663701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073b44c796034aff810c02ee0f255c22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:06.665232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:06.670208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:06.670689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:06.671088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] PATH_INFO: `/v3/projects/23012b91a3274aef98d6e17feab67a02` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:06.683288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=23012b91a3274aef98d6e17feab67a02)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:06.699658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:06.708083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073b44c796034aff810c02ee0f255c22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:06.813857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073b44c796034aff810c02ee0f255c22'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:06.891036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 824/1651] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:06 2022] DELETE /identity/v3/users/073b44c796034aff810c02ee0f255c22 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:06.974136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:07.009107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23012b91a3274aef98d6e17feab67a02', 'request_id': 'req-a8854fdf-b90e-48d2-9895-29508ab6b76a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.047439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23012b91a3274aef98d6e17feab67a02', 'request_id': 'req-a8854fdf-b90e-48d2-9895-29508ab6b76a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.075308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23012b91a3274aef98d6e17feab67a02', 'request_id': 'req-a8854fdf-b90e-48d2-9895-29508ab6b76a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.096456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:07.099045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:07.134590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] The token cache is being invalidate because project 23012b91a3274aef98d6e17feab67a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:07.134915 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.140337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a8854fdf-b90e-48d2-9895-29508ab6b76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.144106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 828/1652] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:06 2022] DELETE /identity/v3/projects/23012b91a3274aef98d6e17feab67a02 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:07.150203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5959-3006-4513-b50d-b6723c369583 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:07.151782 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5959-3006-4513-b50d-b6723c369583 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:07.152867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5959-3006-4513-b50d-b6723c369583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:07.204035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e82f5959-3006-4513-b50d-b6723c369583 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:07.207579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e82f5959-3006-4513-b50d-b6723c369583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:07.239909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9feb5-c645-4aea-acf8-c11352f39de4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:07.344267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:07.345591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:07.346926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:07.347662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] PATH_INFO: `/v3/users/31ce9ef64779422994d3bbdc76506921` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:07.349746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ce9ef64779422994d3bbdc76506921)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:07.352533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:07.368806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 829/1653] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:07.380054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51518a-ed17-4dfc-8b14-21a7b1135639 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:07.380418 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51518a-ed17-4dfc-8b14-21a7b1135639 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:07.380712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51518a-ed17-4dfc-8b14-21a7b1135639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:07.406609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:07.434334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7a51518a-ed17-4dfc-8b14-21a7b1135639 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:07.440103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7a51518a-ed17-4dfc-8b14-21a7b1135639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:07.471503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 830/1654] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:07.472537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51518a-ed17-4dfc-8b14-21a7b1135639 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:07.484849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ce9ef64779422994d3bbdc76506921'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.508552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51518a-ed17-4dfc-8b14-21a7b1135639 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:07.515344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ce9ef64779422994d3bbdc76506921'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.516125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ce9ef64779422994d3bbdc76506921'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.524517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:07.525521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:07.526475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:07.526788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:07.528874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:07.530016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ce9ef64779422994d3bbdc76506921'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.530463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:07.535698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:07.545660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ad24805-3904-49fa-80f6-cc2f7488944f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ce9ef64779422994d3bbdc76506921'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:07.560101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 825/1655] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:07 2022] DELETE /identity/v3/users/31ce9ef64779422994d3bbdc76506921 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:07.566550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e84435-ab15-4ce4-9228-b829e320fbc0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:07.566845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e84435-ab15-4ce4-9228-b829e320fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:07.567185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e84435-ab15-4ce4-9228-b829e320fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:07.589628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 831/1656] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:07.595158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:07.599451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:07.607412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-32e84435-ab15-4ce4-9228-b829e320fbc0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:07.608824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-32e84435-ab15-4ce4-9228-b829e320fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:07.631480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4efe2e-18b5-4b26-b726-3892eaed136f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:07.750596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 826/1657] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:07.782685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c27d9-678e-4396-ac7f-f29056527055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:07.783575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c27d9-678e-4396-ac7f-f29056527055 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:07.783957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c27d9-678e-4396-ac7f-f29056527055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:07.784748 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c27d9-678e-4396-ac7f-f29056527055 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:07.785602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c27d9-678e-4396-ac7f-f29056527055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:07.791779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e84435-ab15-4ce4-9228-b829e320fbc0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:07.792013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c27d9-678e-4396-ac7f-f29056527055 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:07.793435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-32e84435-ab15-4ce4-9228-b829e320fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:07.859183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 832/1658] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:07 2022] POST /identity/v3/projects => generated 403 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:07.863515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c27d9-678e-4396-ac7f-f29056527055 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:07.929627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e84435-ab15-4ce4-9228-b829e320fbc0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:07.960645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:08.045462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3f9f0-cd5f-4529-bab2-44ec4ac9fdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:08.045462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3f9f0-cd5f-4529-bab2-44ec4ac9fdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:08.045462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3f9f0-cd5f-4529-bab2-44ec4ac9fdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:08.048538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3f9f0-cd5f-4529-bab2-44ec4ac9fdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:08.074539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c27d9-678e-4396-ac7f-f29056527055 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:08.088469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3f9f0-cd5f-4529-bab2-44ec4ac9fdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:08.089479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a15214-57ac-403c-9516-b95cb5b69a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:08.089875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3f9f0-cd5f-4529-bab2-44ec4ac9fdd8 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:08.090217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a15214-57ac-403c-9516-b95cb5b69a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:08.090510 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a15214-57ac-403c-9516-b95cb5b69a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:08.090788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a15214-57ac-403c-9516-b95cb5b69a95 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:08.091693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a15214-57ac-403c-9516-b95cb5b69a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:08.094126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a15214-57ac-403c-9516-b95cb5b69a95 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:08.100122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:08.118970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 827/1659] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:57:08.144785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 833/1660] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:07 2022] POST /identity/v3/users => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:57:08.145641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3f9f0-cd5f-4529-bab2-44ec4ac9fdd8 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:08.166529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3f9f0-cd5f-4529-bab2-44ec4ac9fdd8 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:08.185207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5947a-4f0b-4c14-a624-7834379ec038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:08.185981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5947a-4f0b-4c14-a624-7834379ec038 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:08.187137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5947a-4f0b-4c14-a624-7834379ec038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:08.187419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5947a-4f0b-4c14-a624-7834379ec038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:08.188889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5947a-4f0b-4c14-a624-7834379ec038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:08.190733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5947a-4f0b-4c14-a624-7834379ec038 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:08.215066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a15214-57ac-403c-9516-b95cb5b69a95 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:08.216144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 828/1661] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:08.236238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a15214-57ac-403c-9516-b95cb5b69a95 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:08.250767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95615dc4-47df-4f1b-855e-9ce79e0106de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:08.251557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95615dc4-47df-4f1b-855e-9ce79e0106de admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:08.251830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95615dc4-47df-4f1b-855e-9ce79e0106de admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:08.252104 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95615dc4-47df-4f1b-855e-9ce79e0106de admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:08.252867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95615dc4-47df-4f1b-855e-9ce79e0106de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:08.255083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95615dc4-47df-4f1b-855e-9ce79e0106de admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:08.292911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 834/1662] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:08.294183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5947a-4f0b-4c14-a624-7834379ec038 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:08.320235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5947a-4f0b-4c14-a624-7834379ec038 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:08.363383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688901d-36f6-4f6f-88c5-69c24586ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:08.367599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688901d-36f6-4f6f-88c5-69c24586ee54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:08.368193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688901d-36f6-4f6f-88c5-69c24586ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:08.368675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688901d-36f6-4f6f-88c5-69c24586ee54 admin admin] PATH_INFO: `/v3/projects/022134f6c19b496fb3c6932cd2c716b9/users/99957cda2d554185b2e75215c412608a/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:08.442040 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688901d-36f6-4f6f-88c5-69c24586ee54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=022134f6c19b496fb3c6932cd2c716b9, user_id=99957cda2d554185b2e75215c412608a, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:08.455134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688901d-36f6-4f6f-88c5-69c24586ee54 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:08.498165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 829/1663] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:08 2022] PUT /identity/v3/projects/022134f6c19b496fb3c6932cd2c716b9/users/99957cda2d554185b2e75215c412608a/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:08.504423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4037-e51f-4710-b5a9-5f663a2f95bf None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:08.504915 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4037-e51f-4710-b5a9-5f663a2f95bf None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:08.505201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc4037-e51f-4710-b5a9-5f663a2f95bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:08.542249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-78fc4037-e51f-4710-b5a9-5f663a2f95bf None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:08.543564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-78fc4037-e51f-4710-b5a9-5f663a2f95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:08.721885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 835/1664] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:08.776846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688901d-36f6-4f6f-88c5-69c24586ee54 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:08.779755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a688901d-36f6-4f6f-88c5-69c24586ee54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:09.056626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688901d-36f6-4f6f-88c5-69c24586ee54 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:09.090616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237b8fe-5ef3-4798-8f84-53bb4416f7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:09.101547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237b8fe-5ef3-4798-8f84-53bb4416f7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:09.102173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237b8fe-5ef3-4798-8f84-53bb4416f7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:09.102173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237b8fe-5ef3-4798-8f84-53bb4416f7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:09.134813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237b8fe-5ef3-4798-8f84-53bb4416f7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:09.136515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237b8fe-5ef3-4798-8f84-53bb4416f7c9 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:09.207181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 830/1665] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:09.747591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4037-e51f-4710-b5a9-5f663a2f95bf None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:09.750776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-78fc4037-e51f-4710-b5a9-5f663a2f95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:09.779067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc4037-e51f-4710-b5a9-5f663a2f95bf None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:09.798164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:09.802886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:09.803492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:09.805975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] PATH_INFO: `/v3/projects/10543c7254854a2fbe137037ab2b7950` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:09.810244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10543c7254854a2fbe137037ab2b7950)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:09.814895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:10.008902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10543c7254854a2fbe137037ab2b7950', 'request_id': 'req-acb97255-c1e8-414b-8def-dbdb3a94dae4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.019992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10543c7254854a2fbe137037ab2b7950', 'request_id': 'req-acb97255-c1e8-414b-8def-dbdb3a94dae4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.034528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10543c7254854a2fbe137037ab2b7950', 'request_id': 'req-acb97255-c1e8-414b-8def-dbdb3a94dae4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.056548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] The token cache is being invalidate because project 10543c7254854a2fbe137037ab2b7950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:10.057098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.058029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acb97255-c1e8-414b-8def-dbdb3a94dae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.069162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 836/1666] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:09 2022] DELETE /identity/v3/projects/10543c7254854a2fbe137037ab2b7950 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:10.075346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e4204-65c8-448c-9dbc-e9d3364a154b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:10.076178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e4204-65c8-448c-9dbc-e9d3364a154b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:10.076929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e4204-65c8-448c-9dbc-e9d3364a154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:10.112046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-702e4204-65c8-448c-9dbc-e9d3364a154b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:10.114510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-702e4204-65c8-448c-9dbc-e9d3364a154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:10.330277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 831/1667] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:10.339183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfc6b3-73b7-4b30-b4ad-6b23b4a8b491 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:10.339473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfc6b3-73b7-4b30-b4ad-6b23b4a8b491 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:10.339758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfc6b3-73b7-4b30-b4ad-6b23b4a8b491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:10.371374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-abcfc6b3-73b7-4b30-b4ad-6b23b4a8b491 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:10.374107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-abcfc6b3-73b7-4b30-b4ad-6b23b4a8b491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:10.390581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e4204-65c8-448c-9dbc-e9d3364a154b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:10.401560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 837/1668] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:10.404709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e4204-65c8-448c-9dbc-e9d3364a154b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:10.410444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:10.411211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:10.411501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:10.411784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:10.412548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:10.414005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:10.415856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:10.441091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfc6b3-73b7-4b30-b4ad-6b23b4a8b491 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:10.453369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 832/1669] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:57:10.455853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfc6b3-73b7-4b30-b4ad-6b23b4a8b491 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:10.464496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83564b2d-3b19-42e3-a5b1-b489de11cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:10.465622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83564b2d-3b19-42e3-a5b1-b489de11cba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:10.466141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83564b2d-3b19-42e3-a5b1-b489de11cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:10.466650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83564b2d-3b19-42e3-a5b1-b489de11cba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:10.467637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83564b2d-3b19-42e3-a5b1-b489de11cba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:10.473164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83564b2d-3b19-42e3-a5b1-b489de11cba3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:10.486128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:10.492215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:10.553233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0bc9c-36f5-4eed-b6b3-599436aa62c5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:10.580457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:10.586580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:10.586580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:10.586902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] PATH_INFO: `/v3/projects/8fcf2fbd2d714c60a0512acd8c3ffc05` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:10.589501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcf2fbd2d714c60a0512acd8c3ffc05)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:10.600026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:10.601079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 838/1670] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:10 2022] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:10.613108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83564b2d-3b19-42e3-a5b1-b489de11cba3 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:10.632671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:10.758634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83564b2d-3b19-42e3-a5b1-b489de11cba3 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:10.763627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcf2fbd2d714c60a0512acd8c3ffc05', 'request_id': 'req-7930e53d-d535-4229-a2f6-314fc7f826ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.765731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:10.789171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcf2fbd2d714c60a0512acd8c3ffc05', 'request_id': 'req-7930e53d-d535-4229-a2f6-314fc7f826ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.803680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcf2fbd2d714c60a0512acd8c3ffc05', 'request_id': 'req-7930e53d-d535-4229-a2f6-314fc7f826ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.831808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] The token cache is being invalidate because project 8fcf2fbd2d714c60a0512acd8c3ffc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:10.832104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.835093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:10.843007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 833/1671] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:10 2022] DELETE /identity/v3/projects/8fcf2fbd2d714c60a0512acd8c3ffc05 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:10.843687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:10.847101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:10.867581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffcdf-6d1c-4033-aff4-1da65fd99ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:10.868884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffcdf-6d1c-4033-aff4-1da65fd99ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:10.869350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffcdf-6d1c-4033-aff4-1da65fd99ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:10.869846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffcdf-6d1c-4033-aff4-1da65fd99ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:10.880651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ffcdf-6d1c-4033-aff4-1da65fd99ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:10.884186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ffcdf-6d1c-4033-aff4-1da65fd99ab3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:10.934688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 839/1672] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:10 2022] POST /identity/v3/users => generated 301 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:10.939041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffcdf-6d1c-4033-aff4-1da65fd99ab3 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:10.941482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-805ffcdf-6d1c-4033-aff4-1da65fd99ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:10.958461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffcdf-6d1c-4033-aff4-1da65fd99ab3 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:10.974077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7ace6-7f59-4c5f-b7c2-bffaf4d428cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:10.975272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7ace6-7f59-4c5f-b7c2-bffaf4d428cd admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:10.979701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7ace6-7f59-4c5f-b7c2-bffaf4d428cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:10.980196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7ace6-7f59-4c5f-b7c2-bffaf4d428cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:10.981403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7ace6-7f59-4c5f-b7c2-bffaf4d428cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:10.985024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7ace6-7f59-4c5f-b7c2-bffaf4d428cd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:11.004860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 840/1673] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:11.009377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7ace6-7f59-4c5f-b7c2-bffaf4d428cd admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:11.021599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7ace6-7f59-4c5f-b7c2-bffaf4d428cd admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:11.034030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a513eb-a9da-4a04-9f78-71c35987bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:11.034876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a513eb-a9da-4a04-9f78-71c35987bc55 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:11.035293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a513eb-a9da-4a04-9f78-71c35987bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:11.035637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a513eb-a9da-4a04-9f78-71c35987bc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:11.036450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a513eb-a9da-4a04-9f78-71c35987bc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:11.038299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a513eb-a9da-4a04-9f78-71c35987bc55 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:11.044706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930e53d-d535-4229-a2f6-314fc7f826ae admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:11.058295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 841/1674] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:11.059377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a513eb-a9da-4a04-9f78-71c35987bc55 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:11.068852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:11.069824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:11.070131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:11.070416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] PATH_INFO: `/v3/users/fdf96fee9160462a942e7bd4f8e7c0b1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:11.071173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a513eb-a9da-4a04-9f78-71c35987bc55 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:11.077889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf96fee9160462a942e7bd4f8e7c0b1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:11.085062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:11.088983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875250a3-302d-4f6e-9d19-6480692b419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:11.090254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875250a3-302d-4f6e-9d19-6480692b419d admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:11.090613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875250a3-302d-4f6e-9d19-6480692b419d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:11.091196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875250a3-302d-4f6e-9d19-6480692b419d admin admin] PATH_INFO: `/v3/projects/7fe195bd8f314c1d8262e110962a5ff4/users/f4b37ff6cb60459c8a59819038087bb2/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:11.126552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875250a3-302d-4f6e-9d19-6480692b419d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe195bd8f314c1d8262e110962a5ff4, user_id=f4b37ff6cb60459c8a59819038087bb2, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:11.129723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875250a3-302d-4f6e-9d19-6480692b419d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:11.168417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 842/1675] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:11 2022] PUT /identity/v3/projects/7fe195bd8f314c1d8262e110962a5ff4/users/f4b37ff6cb60459c8a59819038087bb2/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:11.172224 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138741e-0627-495c-b822-e713c33fa37c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:11.172520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138741e-0627-495c-b822-e713c33fa37c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:11.172801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138741e-0627-495c-b822-e713c33fa37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:11.252177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf96fee9160462a942e7bd4f8e7c0b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:11.253279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9138741e-0627-495c-b822-e713c33fa37c None None] MFA Rules not processed for user `f4b37ff6cb60459c8a59819038087bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:11.254574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9138741e-0627-495c-b822-e713c33fa37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:11.285765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf96fee9160462a942e7bd4f8e7c0b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:11.292091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf96fee9160462a942e7bd4f8e7c0b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:11.309722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf96fee9160462a942e7bd4f8e7c0b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:11.327228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf96fee9160462a942e7bd4f8e7c0b1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:11.342759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 834/1676] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:10 2022] DELETE /identity/v3/users/fdf96fee9160462a942e7bd4f8e7c0b1 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:11.415175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:11.504613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 843/1677] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:11.511125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:11.516642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:11.771736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:11.783960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe7ce5-6898-4df8-a09e-a59d01953756 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:11.789416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c278-b4e5-467d-806a-0085b9da3c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:11.790313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c278-b4e5-467d-806a-0085b9da3c66 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:11.790566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c278-b4e5-467d-806a-0085b9da3c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:11.791078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c278-b4e5-467d-806a-0085b9da3c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:11.791826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c278-b4e5-467d-806a-0085b9da3c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:11.793893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c278-b4e5-467d-806a-0085b9da3c66 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:11.863640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 835/1678] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:11 2022] POST /identity/v3/projects => generated 401 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:11.869338 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138741e-0627-495c-b822-e713c33fa37c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:12.138315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138741e-0627-495c-b822-e713c33fa37c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:12.342874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b354cb-c405-4a88-9df2-260f48d752b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:12.343610 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b354cb-c405-4a88-9df2-260f48d752b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:12.344048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b354cb-c405-4a88-9df2-260f48d752b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:12.344330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b354cb-c405-4a88-9df2-260f48d752b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:12.345068 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b354cb-c405-4a88-9df2-260f48d752b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:12.350372 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b354cb-c405-4a88-9df2-260f48d752b2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:12.388903 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 844/1679] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:11 2022] POST /identity/v3/users => generated 307 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:12.391324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c278-b4e5-467d-806a-0085b9da3c66 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:12.407147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c278-b4e5-467d-806a-0085b9da3c66 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:12.415564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95642fb-22d7-48f3-9ea2-c00c84eccf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:12.416371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95642fb-22d7-48f3-9ea2-c00c84eccf3c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:12.416662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95642fb-22d7-48f3-9ea2-c00c84eccf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:12.416942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95642fb-22d7-48f3-9ea2-c00c84eccf3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:12.417707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95642fb-22d7-48f3-9ea2-c00c84eccf3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:12.419751 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95642fb-22d7-48f3-9ea2-c00c84eccf3c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:12.443446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 836/1680] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:12.447664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b354cb-c405-4a88-9df2-260f48d752b2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:12.461044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b354cb-c405-4a88-9df2-260f48d752b2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:12.474767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193345b-21ff-46bd-9d46-cc265e152b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:12.476063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193345b-21ff-46bd-9d46-cc265e152b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:12.476524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193345b-21ff-46bd-9d46-cc265e152b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:12.476870 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193345b-21ff-46bd-9d46-cc265e152b30 admin admin] PATH_INFO: `/v3/projects/67152be85f894148973edbc5ff0c50fe/users/1cf6bf5aeed7459884386bd54bc60d52/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:12.495819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193345b-21ff-46bd-9d46-cc265e152b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67152be85f894148973edbc5ff0c50fe, user_id=1cf6bf5aeed7459884386bd54bc60d52, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:12.501063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193345b-21ff-46bd-9d46-cc265e152b30 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:12.528793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 845/1681] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:12 2022] PUT /identity/v3/projects/67152be85f894148973edbc5ff0c50fe/users/1cf6bf5aeed7459884386bd54bc60d52/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:12.530234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95642fb-22d7-48f3-9ea2-c00c84eccf3c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:12.551902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95642fb-22d7-48f3-9ea2-c00c84eccf3c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:12.664048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a472efc-a5aa-400e-9d07-b2793a3daa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:12.664792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a472efc-a5aa-400e-9d07-b2793a3daa9d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:12.672499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a472efc-a5aa-400e-9d07-b2793a3daa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:12.672829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a472efc-a5aa-400e-9d07-b2793a3daa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:12.673653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a472efc-a5aa-400e-9d07-b2793a3daa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:12.681813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a472efc-a5aa-400e-9d07-b2793a3daa9d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:12.699488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 837/1682] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:12.703872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193345b-21ff-46bd-9d46-cc265e152b30 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:12.722766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193345b-21ff-46bd-9d46-cc265e152b30 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:12.738057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f3cd0-cdec-43df-b041-f2533507fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:12.739143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f3cd0-cdec-43df-b041-f2533507fd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:12.739416 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f3cd0-cdec-43df-b041-f2533507fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:12.739692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f3cd0-cdec-43df-b041-f2533507fd0f admin admin] PATH_INFO: `/v3/projects/67152be85f894148973edbc5ff0c50fe/users/1cf6bf5aeed7459884386bd54bc60d52/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:12.748252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f3cd0-cdec-43df-b041-f2533507fd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67152be85f894148973edbc5ff0c50fe, user_id=1cf6bf5aeed7459884386bd54bc60d52, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:12.751939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f3cd0-cdec-43df-b041-f2533507fd0f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:12.783880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 846/1683] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:12 2022] PUT /identity/v3/projects/67152be85f894148973edbc5ff0c50fe/users/1cf6bf5aeed7459884386bd54bc60d52/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:12.797639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302d7f1-ff13-4377-99b7-e631a4e1c6d7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:12.797830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302d7f1-ff13-4377-99b7-e631a4e1c6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:12.803640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302d7f1-ff13-4377-99b7-e631a4e1c6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:12.868244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d302d7f1-ff13-4377-99b7-e631a4e1c6d7 None None] MFA Rules not processed for user `1cf6bf5aeed7459884386bd54bc60d52`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:12.871183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d302d7f1-ff13-4377-99b7-e631a4e1c6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:13.129554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 838/1684] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:13.166376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f3cd0-cdec-43df-b041-f2533507fd0f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:13.169319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-326f3cd0-cdec-43df-b041-f2533507fd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:13.371687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:13.381534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f3cd0-cdec-43df-b041-f2533507fd0f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:13.395839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657909fc-fdf2-4882-ae37-6df98ec2ac53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:13.396723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657909fc-fdf2-4882-ae37-6df98ec2ac53 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:13.397014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657909fc-fdf2-4882-ae37-6df98ec2ac53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:13.397292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657909fc-fdf2-4882-ae37-6df98ec2ac53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:13.417953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657909fc-fdf2-4882-ae37-6df98ec2ac53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:13.420446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657909fc-fdf2-4882-ae37-6df98ec2ac53 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:13.456039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 847/1685] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:13.575940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302d7f1-ff13-4377-99b7-e631a4e1c6d7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:13.594438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302d7f1-ff13-4377-99b7-e631a4e1c6d7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:13.610858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4459b71-48e1-498f-ab65-bdccdb35ad73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:13.613140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459b71-48e1-498f-ab65-bdccdb35ad73 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:13.613788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459b71-48e1-498f-ab65-bdccdb35ad73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:13.614696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459b71-48e1-498f-ab65-bdccdb35ad73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:13.651678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657909fc-fdf2-4882-ae37-6df98ec2ac53 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:13.654554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-657909fc-fdf2-4882-ae37-6df98ec2ac53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:13.803227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:13.821142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4459b71-48e1-498f-ab65-bdccdb35ad73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:13.823129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4459b71-48e1-498f-ab65-bdccdb35ad73 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:13.852262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657909fc-fdf2-4882-ae37-6df98ec2ac53 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:13.855057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 839/1686] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:13.871137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197d765-047f-458b-a6d1-9cd6c2d0adcb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:13.871574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197d765-047f-458b-a6d1-9cd6c2d0adcb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:13.872009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197d765-047f-458b-a6d1-9cd6c2d0adcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:13.882172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:13.883770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:13.884091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:13.884456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] PATH_INFO: `/v3/projects/a6afdcd9d1fb400197e51ccaa059eef6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:13.890421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6afdcd9d1fb400197e51ccaa059eef6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:13.896965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:13.956747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6197d765-047f-458b-a6d1-9cd6c2d0adcb None None] MFA Rules not processed for user `99957cda2d554185b2e75215c412608a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:13.960181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6197d765-047f-458b-a6d1-9cd6c2d0adcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:14.073158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6afdcd9d1fb400197e51ccaa059eef6', 'request_id': 'req-6fc7dbae-06f5-4ffe-b384-fd820704d516'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.096818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6afdcd9d1fb400197e51ccaa059eef6', 'request_id': 'req-6fc7dbae-06f5-4ffe-b384-fd820704d516'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.121433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6afdcd9d1fb400197e51ccaa059eef6', 'request_id': 'req-6fc7dbae-06f5-4ffe-b384-fd820704d516'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.159219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] The token cache is being invalidate because project a6afdcd9d1fb400197e51ccaa059eef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:14.159529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.160423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fc7dbae-06f5-4ffe-b384-fd820704d516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.162586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 848/1687] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:13 2022] DELETE /identity/v3/projects/a6afdcd9d1fb400197e51ccaa059eef6 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:14.169629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4cdd-62e1-46b9-8a26-3091c5e867ac None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:14.170386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4cdd-62e1-46b9-8a26-3091c5e867ac None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:14.170386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4cdd-62e1-46b9-8a26-3091c5e867ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:14.183228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 840/1688] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:14.184992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197d765-047f-458b-a6d1-9cd6c2d0adcb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:14.187374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6197d765-047f-458b-a6d1-9cd6c2d0adcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:14.217208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-45dc4cdd-62e1-46b9-8a26-3091c5e867ac None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:14.220754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197d765-047f-458b-a6d1-9cd6c2d0adcb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:14.224253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-45dc4cdd-62e1-46b9-8a26-3091c5e867ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:14.362777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17aaad-cde3-4db7-acd9-a865011f8ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:14.363667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17aaad-cde3-4db7-acd9-a865011f8ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:14.366016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17aaad-cde3-4db7-acd9-a865011f8ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:14.366557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17aaad-cde3-4db7-acd9-a865011f8ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:14.367565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17aaad-cde3-4db7-acd9-a865011f8ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:14.373308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17aaad-cde3-4db7-acd9-a865011f8ebe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:14.445829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 841/1689] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:14 2022] POST /identity/v3/projects => generated 405 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:14.446065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 849/1690] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:14.446698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17aaad-cde3-4db7-acd9-a865011f8ebe admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:14.447024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4cdd-62e1-46b9-8a26-3091c5e867ac None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:14.451638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ff17aaad-cde3-4db7-acd9-a865011f8ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:14.455808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-45dc4cdd-62e1-46b9-8a26-3091c5e867ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:14.481728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4cdd-62e1-46b9-8a26-3091c5e867ac None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:14.524931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:14.548362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17aaad-cde3-4db7-acd9-a865011f8ebe admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:14.554322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:14.555399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:14.555785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:14.556162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] PATH_INFO: `/v3/users/b4a39c82edb5499ca77ea0882a9c09f2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:14.557776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a39c82edb5499ca77ea0882a9c09f2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:14.560553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:14.566953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:14.625950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a39c82edb5499ca77ea0882a9c09f2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.630920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b930630-7ff2-4fbf-b209-48af93bd3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:14.631701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930630-7ff2-4fbf-b209-48af93bd3cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:14.631990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930630-7ff2-4fbf-b209-48af93bd3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:14.632268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930630-7ff2-4fbf-b209-48af93bd3cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:14.637571 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b930630-7ff2-4fbf-b209-48af93bd3cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:14.640445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b930630-7ff2-4fbf-b209-48af93bd3cd8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:14.646581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a39c82edb5499ca77ea0882a9c09f2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.647563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a39c82edb5499ca77ea0882a9c09f2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.668463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a39c82edb5499ca77ea0882a9c09f2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.694558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a39c82edb5499ca77ea0882a9c09f2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:14.694751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 850/1691] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:14 2022] POST /identity/v3/users => generated 309 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:14.694751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a32d3b-7cc8-4c5c-bae0-9541c9090eb3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:14.694751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a32d3b-7cc8-4c5c-bae0-9541c9090eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:14.694751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a32d3b-7cc8-4c5c-bae0-9541c9090eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:14.719424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 842/1692] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:14 2022] DELETE /identity/v3/users/b4a39c82edb5499ca77ea0882a9c09f2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:14.721685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:14.725551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:14.736487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d3a32d3b-7cc8-4c5c-bae0-9541c9090eb3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:14.737748 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d3a32d3b-7cc8-4c5c-bae0-9541c9090eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:14.978744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07dac2-7741-4496-85a7-41896ad43ce0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.001434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 851/1693] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:15.005780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e97430-f9c9-4c80-a80a-6edfeb2a76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.007941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e97430-f9c9-4c80-a80a-6edfeb2a76a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.009769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e97430-f9c9-4c80-a80a-6edfeb2a76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.010123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e97430-f9c9-4c80-a80a-6edfeb2a76a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.011598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7bc7-a4ce-4f08-a321-a7bb06434acd None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.013581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e97430-f9c9-4c80-a80a-6edfeb2a76a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.014267 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7bc7-a4ce-4f08-a321-a7bb06434acd None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.017430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7bc7-a4ce-4f08-a321-a7bb06434acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.026457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e97430-f9c9-4c80-a80a-6edfeb2a76a6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:15.075581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 843/1694] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:15.078081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6e5e7bc7-a4ce-4f08-a321-a7bb06434acd None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:15.080465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e97430-f9c9-4c80-a80a-6edfeb2a76a6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:15.082383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6e5e7bc7-a4ce-4f08-a321-a7bb06434acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:15.105146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 852/1695] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:15.106489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7bc7-a4ce-4f08-a321-a7bb06434acd None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:15.107469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e97430-f9c9-4c80-a80a-6edfeb2a76a6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.123834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87307f-65c7-4596-a9ca-77e1b9864f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.125553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87307f-65c7-4596-a9ca-77e1b9864f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.125911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87307f-65c7-4596-a9ca-77e1b9864f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.126340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87307f-65c7-4596-a9ca-77e1b9864f01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.127235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87307f-65c7-4596-a9ca-77e1b9864f01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:15.129234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87307f-65c7-4596-a9ca-77e1b9864f01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.132096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7bc7-a4ce-4f08-a321-a7bb06434acd None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.132469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87307f-65c7-4596-a9ca-77e1b9864f01 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:15.152949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e435e-f812-43ba-ad39-e3d90c2643a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.156610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 844/1696] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:15.158506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e435e-f812-43ba-ad39-e3d90c2643a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.158817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e435e-f812-43ba-ad39-e3d90c2643a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.159101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e435e-f812-43ba-ad39-e3d90c2643a7 admin admin] PATH_INFO: `/v3/projects/5764603e92ef44cabc923dbc15ba8545/users/7b3204b081784f8e98940cffb799b8d8/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.163815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87307f-65c7-4596-a9ca-77e1b9864f01 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:15.185440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87307f-65c7-4596-a9ca-77e1b9864f01 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.215684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd9956-bcf7-47c9-836b-03f4a68d174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.220144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd9956-bcf7-47c9-836b-03f4a68d174a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.221167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd9956-bcf7-47c9-836b-03f4a68d174a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.223647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e435e-f812-43ba-ad39-e3d90c2643a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5764603e92ef44cabc923dbc15ba8545, user_id=7b3204b081784f8e98940cffb799b8d8, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.224945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd9956-bcf7-47c9-836b-03f4a68d174a admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.231724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd9956-bcf7-47c9-836b-03f4a68d174a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.235685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e435e-f812-43ba-ad39-e3d90c2643a7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:15.245732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd9956-bcf7-47c9-836b-03f4a68d174a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:15.272980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 853/1697] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:15 2022] PUT /identity/v3/projects/5764603e92ef44cabc923dbc15ba8545/users/7b3204b081784f8e98940cffb799b8d8/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:15.277189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e435e-f812-43ba-ad39-e3d90c2643a7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:15.284142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3b3e435e-f812-43ba-ad39-e3d90c2643a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:15.374719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 845/1698] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:15 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:15.377024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd9956-bcf7-47c9-836b-03f4a68d174a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:15.440674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e435e-f812-43ba-ad39-e3d90c2643a7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.511167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:15.529622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:15.554443 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd9956-bcf7-47c9-836b-03f4a68d174a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.563680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b61137-1423-4154-b221-626b03671053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.564467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b61137-1423-4154-b221-626b03671053 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.564691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b61137-1423-4154-b221-626b03671053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.564968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b61137-1423-4154-b221-626b03671053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.565727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b61137-1423-4154-b221-626b03671053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.576918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b61137-1423-4154-b221-626b03671053 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:15.577922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344231b5-b520-475b-b31b-973e0210d71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.578882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344231b5-b520-475b-b31b-973e0210d71b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.579169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344231b5-b520-475b-b31b-973e0210d71b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.579451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344231b5-b520-475b-b31b-973e0210d71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.595874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 846/1699] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:15.596763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b61137-1423-4154-b221-626b03671053 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:15.605407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344231b5-b520-475b-b31b-973e0210d71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.607265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344231b5-b520-475b-b31b-973e0210d71b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:15.629008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b61137-1423-4154-b221-626b03671053 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.631961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 854/1700] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:15.633096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344231b5-b520-475b-b31b-973e0210d71b service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:15.635265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c378f54-378d-4715-b1e1-fe02ea9be37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.636022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378f54-378d-4715-b1e1-fe02ea9be37f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.636526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378f54-378d-4715-b1e1-fe02ea9be37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.636644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378f54-378d-4715-b1e1-fe02ea9be37f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.637340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c378f54-378d-4715-b1e1-fe02ea9be37f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.639434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c378f54-378d-4715-b1e1-fe02ea9be37f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:15.682870 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344231b5-b520-475b-b31b-973e0210d71b service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.701985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96750e5-39d6-453d-846c-87c4adfc0de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.703020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96750e5-39d6-453d-846c-87c4adfc0de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.703304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96750e5-39d6-453d-846c-87c4adfc0de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.703443 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 847/1701] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:15 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:15.703617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96750e5-39d6-453d-846c-87c4adfc0de6 admin admin] PATH_INFO: `/v3/projects/5764603e92ef44cabc923dbc15ba8545/users/7b3204b081784f8e98940cffb799b8d8/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.708626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c378f54-378d-4715-b1e1-fe02ea9be37f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:15.712092 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96750e5-39d6-453d-846c-87c4adfc0de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5764603e92ef44cabc923dbc15ba8545, user_id=7b3204b081784f8e98940cffb799b8d8, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.715131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96750e5-39d6-453d-846c-87c4adfc0de6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:15.728185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c378f54-378d-4715-b1e1-fe02ea9be37f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.740879 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa830e1-d8d3-455d-a59b-9ff623b90440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.742323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa830e1-d8d3-455d-a59b-9ff623b90440 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.742629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa830e1-d8d3-455d-a59b-9ff623b90440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.742912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa830e1-d8d3-455d-a59b-9ff623b90440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.743681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa830e1-d8d3-455d-a59b-9ff623b90440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.744716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 855/1702] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:15 2022] PUT /identity/v3/projects/5764603e92ef44cabc923dbc15ba8545/users/7b3204b081784f8e98940cffb799b8d8/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:15.745388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa830e1-d8d3-455d-a59b-9ff623b90440 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:15.799948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 848/1703] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:15.804104 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96750e5-39d6-453d-846c-87c4adfc0de6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:15.956077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96750e5-39d6-453d-846c-87c4adfc0de6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:15.968189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca65fd-be84-4acb-8122-effb813e206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:15.968897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca65fd-be84-4acb-8122-effb813e206d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:15.969182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca65fd-be84-4acb-8122-effb813e206d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:15.969458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca65fd-be84-4acb-8122-effb813e206d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:15.982120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca65fd-be84-4acb-8122-effb813e206d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:15.982120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca65fd-be84-4acb-8122-effb813e206d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:16.000917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 856/1704] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:16.005228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa830e1-d8d3-455d-a59b-9ff623b90440 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:16.021568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa830e1-d8d3-455d-a59b-9ff623b90440 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:16.034856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9664923-75e9-468e-b976-1721236f0047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:16.035826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9664923-75e9-468e-b976-1721236f0047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:16.036117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9664923-75e9-468e-b976-1721236f0047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:16.036399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9664923-75e9-468e-b976-1721236f0047 admin admin] PATH_INFO: `/v3/projects/1daf2fdb07624a4bbb341ae0a27a0a5f/users/39b34ce27af84b72be59b1321c04979e/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:16.080635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9664923-75e9-468e-b976-1721236f0047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1daf2fdb07624a4bbb341ae0a27a0a5f, user_id=39b34ce27af84b72be59b1321c04979e, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:16.083565 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9664923-75e9-468e-b976-1721236f0047 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:16.107967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 849/1705] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:16 2022] PUT /identity/v3/projects/1daf2fdb07624a4bbb341ae0a27a0a5f/users/39b34ce27af84b72be59b1321c04979e/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:16.120328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b31944-2bfc-4b42-a1f1-aeb0cd15aea9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:16.122581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b31944-2bfc-4b42-a1f1-aeb0cd15aea9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:16.123127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b31944-2bfc-4b42-a1f1-aeb0cd15aea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:16.225205 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-20b31944-2bfc-4b42-a1f1-aeb0cd15aea9 None None] MFA Rules not processed for user `39b34ce27af84b72be59b1321c04979e`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:16.228369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-20b31944-2bfc-4b42-a1f1-aeb0cd15aea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:16.524767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 857/1706] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:16.531619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9664923-75e9-468e-b976-1721236f0047 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:16.677493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9664923-75e9-468e-b976-1721236f0047 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:16.711464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e1c1e-b7c6-4948-81fb-5d2a72a323f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:16.722580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e1c1e-b7c6-4948-81fb-5d2a72a323f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:16.723054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e1c1e-b7c6-4948-81fb-5d2a72a323f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:16.723471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e1c1e-b7c6-4948-81fb-5d2a72a323f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:16.724733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e1c1e-b7c6-4948-81fb-5d2a72a323f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:16.744406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e1c1e-b7c6-4948-81fb-5d2a72a323f6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:16.913722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 850/1707] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:16 2022] POST /identity/v3/projects => generated 381 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:16.920233 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b31944-2bfc-4b42-a1f1-aeb0cd15aea9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:16.941396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b31944-2bfc-4b42-a1f1-aeb0cd15aea9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:17.019303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:17.035042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060cb87-d44a-47bb-8fa6-658d2813b15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:17.036020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060cb87-d44a-47bb-8fa6-658d2813b15a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:17.036431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060cb87-d44a-47bb-8fa6-658d2813b15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:17.036805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060cb87-d44a-47bb-8fa6-658d2813b15a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:17.037786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060cb87-d44a-47bb-8fa6-658d2813b15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:17.040515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060cb87-d44a-47bb-8fa6-658d2813b15a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:17.073991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 858/1708] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:16 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:17.081211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e1c1e-b7c6-4948-81fb-5d2a72a323f6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:17.109468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e1c1e-b7c6-4948-81fb-5d2a72a323f6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:17.124637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44141-7cc5-4df2-9b89-6369a214cecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:17.125668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44141-7cc5-4df2-9b89-6369a214cecb admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:17.126913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44141-7cc5-4df2-9b89-6369a214cecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:17.128865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44141-7cc5-4df2-9b89-6369a214cecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:17.129943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb44141-7cc5-4df2-9b89-6369a214cecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:17.132916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb44141-7cc5-4df2-9b89-6369a214cecb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:17.179320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 851/1709] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:17.188182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060cb87-d44a-47bb-8fa6-658d2813b15a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:17.226229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060cb87-d44a-47bb-8fa6-658d2813b15a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:17.242613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298707-d9e8-403f-a7ce-c3ab191506de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:17.244051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298707-d9e8-403f-a7ce-c3ab191506de admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:17.244511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298707-d9e8-403f-a7ce-c3ab191506de admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:17.244973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298707-d9e8-403f-a7ce-c3ab191506de admin admin] PATH_INFO: `/v3/projects/6e3b90d3d8f04bdba57150b733b9ad73/users/e8363916825445c292402e86079df571/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:17.303119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3298707-d9e8-403f-a7ce-c3ab191506de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3b90d3d8f04bdba57150b733b9ad73, user_id=e8363916825445c292402e86079df571, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:17.314545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3298707-d9e8-403f-a7ce-c3ab191506de admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:17.370706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 859/1710] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:17 2022] PUT /identity/v3/projects/6e3b90d3d8f04bdba57150b733b9ad73/users/e8363916825445c292402e86079df571/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:17.375702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44141-7cc5-4df2-9b89-6369a214cecb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:17.399334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44141-7cc5-4df2-9b89-6369a214cecb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:17.563603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b06b-a883-4b2a-8e8d-2d59b3096e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:17.564489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b06b-a883-4b2a-8e8d-2d59b3096e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:17.564866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b06b-a883-4b2a-8e8d-2d59b3096e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:17.565236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b06b-a883-4b2a-8e8d-2d59b3096e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:17.566250 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169b06b-a883-4b2a-8e8d-2d59b3096e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:17.568581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169b06b-a883-4b2a-8e8d-2d59b3096e4e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:17.576074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:17.604682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 852/1711] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:17.608923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298707-d9e8-403f-a7ce-c3ab191506de admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:17.625999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298707-d9e8-403f-a7ce-c3ab191506de admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:17.633234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bdb12-7feb-46d8-8c0f-5010b3af6c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:17.635029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bdb12-7feb-46d8-8c0f-5010b3af6c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:17.635708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bdb12-7feb-46d8-8c0f-5010b3af6c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:17.636181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bdb12-7feb-46d8-8c0f-5010b3af6c84 admin admin] PATH_INFO: `/v3/projects/6e3b90d3d8f04bdba57150b733b9ad73/users/e8363916825445c292402e86079df571/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:17.638896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bdb12-7feb-46d8-8c0f-5010b3af6c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3b90d3d8f04bdba57150b733b9ad73, user_id=e8363916825445c292402e86079df571, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:17.642832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bdb12-7feb-46d8-8c0f-5010b3af6c84 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:17.660215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 860/1712] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:17 2022] PUT /identity/v3/projects/6e3b90d3d8f04bdba57150b733b9ad73/users/e8363916825445c292402e86079df571/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:17.686771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97895183-9731-46c9-9d54-fd952b9e7bed None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:17.686771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97895183-9731-46c9-9d54-fd952b9e7bed None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:17.687290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97895183-9731-46c9-9d54-fd952b9e7bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:17.739663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8c44d-0c0e-4c44-b7b7-19edf684ff4a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:17.739960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8c44d-0c0e-4c44-b7b7-19edf684ff4a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:17.740225 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8c44d-0c0e-4c44-b7b7-19edf684ff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:17.785527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-97895183-9731-46c9-9d54-fd952b9e7bed None None] MFA Rules not processed for user `e8363916825445c292402e86079df571`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:17.794435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-97895183-9731-46c9-9d54-fd952b9e7bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:17.813802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b7d8c44d-0c0e-4c44-b7b7-19edf684ff4a None None] MFA Rules not processed for user `8bfbd9324f8040c496a83eb599ca80c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:17.815234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b7d8c44d-0c0e-4c44-b7b7-19edf684ff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:18.058353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 853/1713] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:18.058472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 861/1714] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:18.065799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97895183-9731-46c9-9d54-fd952b9e7bed None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:18.067266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-97895183-9731-46c9-9d54-fd952b9e7bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:18.073340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8c44d-0c0e-4c44-b7b7-19edf684ff4a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:18.074988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b7d8c44d-0c0e-4c44-b7b7-19edf684ff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:18.276107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8c44d-0c0e-4c44-b7b7-19edf684ff4a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:18.295802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4882a0-0c44-4bd3-ae6c-32703b7b3676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:18.296666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4882a0-0c44-4bd3-ae6c-32703b7b3676 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:18.297039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4882a0-0c44-4bd3-ae6c-32703b7b3676 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:18.297322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4882a0-0c44-4bd3-ae6c-32703b7b3676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:18.333980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4882a0-0c44-4bd3-ae6c-32703b7b3676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:18.336430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4882a0-0c44-4bd3-ae6c-32703b7b3676 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:18.383044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 862/1715] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:18.464253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97895183-9731-46c9-9d54-fd952b9e7bed None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:18.489055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9739a-74a6-4eb6-85f4-2c738736de70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:18.489055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9739a-74a6-4eb6-85f4-2c738736de70 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:18.489055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9739a-74a6-4eb6-85f4-2c738736de70 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:18.489055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9739a-74a6-4eb6-85f4-2c738736de70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:18.526331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9739a-74a6-4eb6-85f4-2c738736de70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:18.528055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9739a-74a6-4eb6-85f4-2c738736de70 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:18.562848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 854/1716] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:19.301939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4882a0-0c44-4bd3-ae6c-32703b7b3676 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:19.325982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4882a0-0c44-4bd3-ae6c-32703b7b3676 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:19.345653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5d636-601a-4d16-806d-cf42ee110f83 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8363916825445c292402e86079df571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e3b90d3d8f04bdba57150b733b9ad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:19.346758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5d636-601a-4d16-806d-cf42ee110f83 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:19.347210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5d636-601a-4d16-806d-cf42ee110f83 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:19.347703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5d636-601a-4d16-806d-cf42ee110f83 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:19.348693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5d636-601a-4d16-806d-cf42ee110f83 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:19.349195 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5d636-601a-4d16-806d-cf42ee110f83 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:19.355679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5d636-601a-4d16-806d-cf42ee110f83 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:19.372217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9739a-74a6-4eb6-85f4-2c738736de70 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:19.373251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a0e9739a-74a6-4eb6-85f4-2c738736de70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:19.411187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 863/1717] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:19.412474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5d636-601a-4d16-806d-cf42ee110f83 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:19.441798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5d636-601a-4d16-806d-cf42ee110f83 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:19.457477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c76df-b5d8-4824-a2bd-02b22fa023da tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8363916825445c292402e86079df571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e3b90d3d8f04bdba57150b733b9ad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:19.458632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c76df-b5d8-4824-a2bd-02b22fa023da tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:19.459198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c76df-b5d8-4824-a2bd-02b22fa023da tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:19.461962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c76df-b5d8-4824-a2bd-02b22fa023da tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:19.464204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c76df-b5d8-4824-a2bd-02b22fa023da tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:19.473931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c76df-b5d8-4824-a2bd-02b22fa023da tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:19.532909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:19.552228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 864/1718] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:19 2022] POST /identity/v3/projects => generated 355 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:19.553350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c76df-b5d8-4824-a2bd-02b22fa023da tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:19.560784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9739a-74a6-4eb6-85f4-2c738736de70 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:19.601941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:19.736809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:19.738428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:19.739295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:19.739792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] PATH_INFO: `/v3/projects/11083bc01e5140c9b8e947efd72362af` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:19.741740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=11083bc01e5140c9b8e947efd72362af)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:19.746476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:19.760538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c76df-b5d8-4824-a2bd-02b22fa023da tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:19.772314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc23b9e-ee19-4c7b-a506-ad3f6417e66f tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8363916825445c292402e86079df571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e3b90d3d8f04bdba57150b733b9ad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:19.773061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc23b9e-ee19-4c7b-a506-ad3f6417e66f tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:19.773364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc23b9e-ee19-4c7b-a506-ad3f6417e66f tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:19.773641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc23b9e-ee19-4c7b-a506-ad3f6417e66f tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:19.774455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc23b9e-ee19-4c7b-a506-ad3f6417e66f tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:19.774771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc23b9e-ee19-4c7b-a506-ad3f6417e66f tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:19.776524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc23b9e-ee19-4c7b-a506-ad3f6417e66f tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:19.816790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 865/1719] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:19.818501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d5332-3028-4eec-8e8d-01a51294ff5c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:19.818747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d5332-3028-4eec-8e8d-01a51294ff5c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:19.819031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d5332-3028-4eec-8e8d-01a51294ff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:19.859775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-412d5332-3028-4eec-8e8d-01a51294ff5c None None] MFA Rules not processed for user `847c39439e874e68b72e07c311a53bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:19.861120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-412d5332-3028-4eec-8e8d-01a51294ff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:19.927328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11083bc01e5140c9b8e947efd72362af', 'request_id': 'req-33d133e5-5bee-4b89-b743-3222c5919eac'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:19.961265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11083bc01e5140c9b8e947efd72362af', 'request_id': 'req-33d133e5-5bee-4b89-b743-3222c5919eac'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:19.991963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11083bc01e5140c9b8e947efd72362af', 'request_id': 'req-33d133e5-5bee-4b89-b743-3222c5919eac'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:20.047577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] The token cache is being invalidate because project 11083bc01e5140c9b8e947efd72362af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:20.047807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:20.052331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:20.064276 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 855/1720] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:19 2022] DELETE /identity/v3/projects/11083bc01e5140c9b8e947efd72362af => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:20.066325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:20.073516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 866/1721] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:20.075313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a9268-9b48-48ba-a79d-6143cb8720ef None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:20.075526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a9268-9b48-48ba-a79d-6143cb8720ef None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:20.075715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a9268-9b48-48ba-a79d-6143cb8720ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:20.088388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:20.141821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8f1a9268-9b48-48ba-a79d-6143cb8720ef None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:20.144548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8f1a9268-9b48-48ba-a79d-6143cb8720ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:20.364528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d133e5-5bee-4b89-b743-3222c5919eac admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:20.370324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8363916825445c292402e86079df571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e3b90d3d8f04bdba57150b733b9ad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:20.379937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:20.381038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:20.381522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] PATH_INFO: `/v3/projects/5af5a2c43e094bd1b14d27bb3e72d874` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:20.383767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5af5a2c43e094bd1b14d27bb3e72d874)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:20.397849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:20.527021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af5a2c43e094bd1b14d27bb3e72d874', 'request_id': 'req-8c49a797-c4ea-425b-a4b1-380de7f33d23'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:20.529846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 867/1722] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:20.531697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a9268-9b48-48ba-a79d-6143cb8720ef None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:20.534983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:20.544061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8f1a9268-9b48-48ba-a79d-6143cb8720ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:20.552373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af5a2c43e094bd1b14d27bb3e72d874', 'request_id': 'req-8c49a797-c4ea-425b-a4b1-380de7f33d23'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:20.573220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af5a2c43e094bd1b14d27bb3e72d874', 'request_id': 'req-8c49a797-c4ea-425b-a4b1-380de7f33d23'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:20.598746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] The token cache is being invalidate because project 5af5a2c43e094bd1b14d27bb3e72d874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:20.599469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:20.601278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c49a797-c4ea-425b-a4b1-380de7f33d23 tempest-VolumeQuotaClassesTest-1637291371 tempest-VolumeQuotaClassesTest-1637291371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:20.604455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 856/1723] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:20 2022] DELETE /identity/v3/projects/5af5a2c43e094bd1b14d27bb3e72d874 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:20.609978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4d62d-e5ab-45eb-bbe1-1c7e2edb18d9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:20.609978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4d62d-e5ab-45eb-bbe1-1c7e2edb18d9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:20.609978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4d62d-e5ab-45eb-bbe1-1c7e2edb18d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:20.626182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:20.688371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f7c4d62d-e5ab-45eb-bbe1-1c7e2edb18d9 None None] MFA Rules not processed for user `7b3204b081784f8e98940cffb799b8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:20.689785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f7c4d62d-e5ab-45eb-bbe1-1c7e2edb18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:20.695453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a9268-9b48-48ba-a79d-6143cb8720ef None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:20.795044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:20.795801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:20.796087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:20.796694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:20.799702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:20.894817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:20.896774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:20.907792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 868/1724] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:20.910013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 857/1725] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:20.931416 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:20.931834 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5476a-e7b7-44d2-aaab-00e7cfd307b8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:20.932185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5476a-e7b7-44d2-aaab-00e7cfd307b8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:20.932469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5476a-e7b7-44d2-aaab-00e7cfd307b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:20.933056 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:20.985973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-efc5476a-e7b7-44d2-aaab-00e7cfd307b8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:20.987277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-efc5476a-e7b7-44d2-aaab-00e7cfd307b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:21.144609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 858/1726] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:21.147127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5476a-e7b7-44d2-aaab-00e7cfd307b8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:21.158184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c1a8-f176-42bf-98f7-623b24de2129 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:21.170621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:21.171565 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:21.173549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:21.173848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] PATH_INFO: `/v3/users/f4b37ff6cb60459c8a59819038087bb2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:21.176549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5476a-e7b7-44d2-aaab-00e7cfd307b8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:21.181562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b37ff6cb60459c8a59819038087bb2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:21.194176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:21.196255 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb54ec-b988-430f-bfeb-ff6f0b63f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:21.197019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb54ec-b988-430f-bfeb-ff6f0b63f5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:21.197311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb54ec-b988-430f-bfeb-ff6f0b63f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:21.197586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb54ec-b988-430f-bfeb-ff6f0b63f5f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:21.198627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb54ec-b988-430f-bfeb-ff6f0b63f5f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:21.199081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb54ec-b988-430f-bfeb-ff6f0b63f5f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:21.201185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:21.203795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb54ec-b988-430f-bfeb-ff6f0b63f5f7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:21.242235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 859/1727] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:21.243258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb54ec-b988-430f-bfeb-ff6f0b63f5f7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:21.257543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb54ec-b988-430f-bfeb-ff6f0b63f5f7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:21.288340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a7c92-74b4-4276-85e9-5d9fd94d04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:21.289864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a7c92-74b4-4276-85e9-5d9fd94d04e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:21.290816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a7c92-74b4-4276-85e9-5d9fd94d04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:21.291104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a7c92-74b4-4276-85e9-5d9fd94d04e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:21.305604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a7c92-74b4-4276-85e9-5d9fd94d04e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:21.308473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a7c92-74b4-4276-85e9-5d9fd94d04e6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:21.317716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b37ff6cb60459c8a59819038087bb2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.318706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b37ff6cb60459c8a59819038087bb2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.319531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b37ff6cb60459c8a59819038087bb2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.342948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b37ff6cb60459c8a59819038087bb2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.366000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b37ff6cb60459c8a59819038087bb2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.374866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 860/1728] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:21 2022] POST /identity/v3/projects => generated 359 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:21.377479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a7c92-74b4-4276-85e9-5d9fd94d04e6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:21.382906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-673a7c92-74b4-4276-85e9-5d9fd94d04e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:21.420863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 869/1729] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:20 2022] DELETE /identity/v3/users/f4b37ff6cb60459c8a59819038087bb2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:21.422291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:21.429398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:21.516385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:21.610426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4c75a-451a-4577-a9a2-e9d422f9b55c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:21.617119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bcc8a-0678-4c70-897a-201ca99ab532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:21.617891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bcc8a-0678-4c70-897a-201ca99ab532 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:21.618707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bcc8a-0678-4c70-897a-201ca99ab532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:21.618707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bcc8a-0678-4c70-897a-201ca99ab532 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:21.619367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bcc8a-0678-4c70-897a-201ca99ab532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:21.621445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bcc8a-0678-4c70-897a-201ca99ab532 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:21.632863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a7c92-74b4-4276-85e9-5d9fd94d04e6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:21.654822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:21.659634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:21.665218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:21.665716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] PATH_INFO: `/v3/users/39b34ce27af84b72be59b1321c04979e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:21.669101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b34ce27af84b72be59b1321c04979e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:21.677584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 870/1730] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:21 2022] POST /identity/v3/users => generated 280 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:21.678172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:21.680472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2edc2f-fde4-4be6-9274-6b776472c016 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:21.682984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2edc2f-fde4-4be6-9274-6b776472c016 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:21.684530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2edc2f-fde4-4be6-9274-6b776472c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:21.728367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7a2edc2f-fde4-4be6-9274-6b776472c016 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:21.731313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7a2edc2f-fde4-4be6-9274-6b776472c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:21.755319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 871/1731] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:21.755541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0292-5024-4d09-8931-fe6af01ce44e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:21.756185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0292-5024-4d09-8931-fe6af01ce44e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:21.756572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0292-5024-4d09-8931-fe6af01ce44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:21.800756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b34ce27af84b72be59b1321c04979e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.840699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b34ce27af84b72be59b1321c04979e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.841524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b34ce27af84b72be59b1321c04979e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.850443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-85df0292-5024-4d09-8931-fe6af01ce44e None None] MFA Rules not processed for user `b75243e37f2342c0a428d39e193e0d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:21.852317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-85df0292-5024-4d09-8931-fe6af01ce44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:21.857624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b34ce27af84b72be59b1321c04979e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.894490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b34ce27af84b72be59b1321c04979e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:21.910786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 861/1732] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:21 2022] DELETE /identity/v3/users/39b34ce27af84b72be59b1321c04979e => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:21.911847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:21.913321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:21.953435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:22.003650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 872/1733] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:22.007846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df0292-5024-4d09-8931-fe6af01ce44e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:22.012738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-85df0292-5024-4d09-8931-fe6af01ce44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:22.093979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63a0a1-bd7a-4cc5-9ffc-9ebf7ae8bdfe admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:22.112013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cf15d-14a5-4255-af6a-722aedcd1a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:22.112736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cf15d-14a5-4255-af6a-722aedcd1a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:22.113560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cf15d-14a5-4255-af6a-722aedcd1a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:22.113560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cf15d-14a5-4255-af6a-722aedcd1a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:22.114029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cf15d-14a5-4255-af6a-722aedcd1a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:22.115767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cf15d-14a5-4255-af6a-722aedcd1a5a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:22.148027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 862/1734] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:22.152435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d53f-79d0-40a3-b794-4c19ba802a2d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:22.152889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d53f-79d0-40a3-b794-4c19ba802a2d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:22.156256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d53f-79d0-40a3-b794-4c19ba802a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:22.196927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c685d53f-79d0-40a3-b794-4c19ba802a2d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:22.198188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c685d53f-79d0-40a3-b794-4c19ba802a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:22.203944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df0292-5024-4d09-8931-fe6af01ce44e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:22.220493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 863/1735] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:22.228966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0303b-fd9a-4eea-8b66-ddfa4d637b42 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:22.229518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0303b-fd9a-4eea-8b66-ddfa4d637b42 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:22.229985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0303b-fd9a-4eea-8b66-ddfa4d637b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:22.269676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cae0303b-fd9a-4eea-8b66-ddfa4d637b42 None None] MFA Rules not processed for user `b75243e37f2342c0a428d39e193e0d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:22.272688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cae0303b-fd9a-4eea-8b66-ddfa4d637b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:22.338650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48678870-4f3e-4882-afe2-208797d4b35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:22.339630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48678870-4f3e-4882-afe2-208797d4b35b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:22.340094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48678870-4f3e-4882-afe2-208797d4b35b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:22.340697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48678870-4f3e-4882-afe2-208797d4b35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:22.343322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-48678870-4f3e-4882-afe2-208797d4b35b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:22.358069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48678870-4f3e-4882-afe2-208797d4b35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:22.360209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48678870-4f3e-4882-afe2-208797d4b35b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:22.364601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:22.385974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 873/1736] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:22.388542 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48678870-4f3e-4882-afe2-208797d4b35b service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:22.421456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 864/1737] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:22.422538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0303b-fd9a-4eea-8b66-ddfa4d637b42 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:22.423434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48678870-4f3e-4882-afe2-208797d4b35b service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:22.444774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baeb6f-7759-4d0a-ac98-1815b56d69f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:22.445642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baeb6f-7759-4d0a-ac98-1815b56d69f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:22.446033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baeb6f-7759-4d0a-ac98-1815b56d69f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:22.446456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baeb6f-7759-4d0a-ac98-1815b56d69f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:22.447421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0303b-fd9a-4eea-8b66-ddfa4d637b42 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:22.448354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baeb6f-7759-4d0a-ac98-1815b56d69f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:22.454897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baeb6f-7759-4d0a-ac98-1815b56d69f1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:22.464513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076e0f-6146-4206-977e-71dc99454482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:22.465518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076e0f-6146-4206-977e-71dc99454482 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:22.465630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076e0f-6146-4206-977e-71dc99454482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:22.465832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076e0f-6146-4206-977e-71dc99454482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:22.502588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 874/1738] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:22.503696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baeb6f-7759-4d0a-ac98-1815b56d69f1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:22.509649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-64baeb6f-7759-4d0a-ac98-1815b56d69f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:22.513755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076e0f-6146-4206-977e-71dc99454482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:22.521148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076e0f-6146-4206-977e-71dc99454482 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:22.541630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 865/1739] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:22.542860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076e0f-6146-4206-977e-71dc99454482 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:22.571872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076e0f-6146-4206-977e-71dc99454482 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:22.595463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6b545-c79e-4f87-8563-732eeeef0604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:22.598057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6b545-c79e-4f87-8563-732eeeef0604 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:22.598758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6b545-c79e-4f87-8563-732eeeef0604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:22.599374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6b545-c79e-4f87-8563-732eeeef0604 admin admin] PATH_INFO: `/v3/projects/fa052b1e5c5a495cb2d8ab6b522832d5/users/e640d93c66fa4419af6cc0fedaf54cc3/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:22.642772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6b545-c79e-4f87-8563-732eeeef0604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa052b1e5c5a495cb2d8ab6b522832d5, user_id=e640d93c66fa4419af6cc0fedaf54cc3, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:22.653183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6b545-c79e-4f87-8563-732eeeef0604 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:22.704788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 866/1740] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:22 2022] PUT /identity/v3/projects/fa052b1e5c5a495cb2d8ab6b522832d5/users/e640d93c66fa4419af6cc0fedaf54cc3/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:22.716635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e31792-a9af-4061-806b-50a55666fd1d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:22.716746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e31792-a9af-4061-806b-50a55666fd1d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:22.716990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e31792-a9af-4061-806b-50a55666fd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:22.801656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f5e31792-a9af-4061-806b-50a55666fd1d None None] MFA Rules not processed for user `e640d93c66fa4419af6cc0fedaf54cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:22.805637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f5e31792-a9af-4061-806b-50a55666fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:22.875817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baeb6f-7759-4d0a-ac98-1815b56d69f1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:22.980966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:22.987221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 867/1741] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:23.003232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e31792-a9af-4061-806b-50a55666fd1d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:23.071246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b951876-15bb-40aa-9802-de55c1f815dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:23.072346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b951876-15bb-40aa-9802-de55c1f815dd service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:23.074272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b951876-15bb-40aa-9802-de55c1f815dd service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:23.085811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b951876-15bb-40aa-9802-de55c1f815dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:23.211544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e31792-a9af-4061-806b-50a55666fd1d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:23.239875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aabe72-8b2c-48d4-b591-86dd78c68ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:23.240586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabe72-8b2c-48d4-b591-86dd78c68ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:23.240872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabe72-8b2c-48d4-b591-86dd78c68ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:23.241142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabe72-8b2c-48d4-b591-86dd78c68ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:23.241851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aabe72-8b2c-48d4-b591-86dd78c68ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:23.258355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aabe72-8b2c-48d4-b591-86dd78c68ab1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:23.399733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b951876-15bb-40aa-9802-de55c1f815dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:23.411554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b951876-15bb-40aa-9802-de55c1f815dd service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:23.427510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 868/1742] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:23 2022] POST /identity/v3/projects => generated 365 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:23.431414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faf071-666b-4c2a-8ac7-970baeeaddea None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:23.437898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faf071-666b-4c2a-8ac7-970baeeaddea None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:23.438740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faf071-666b-4c2a-8ac7-970baeeaddea None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:23.445293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 869/1743] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 12:57:23 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:57:23.449251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faf071-666b-4c2a-8ac7-970baeeaddea None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:23.461135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 875/1744] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 958 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:23.494366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea1ae1-e9fb-4600-9c0b-2483f07f7e4a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:23.494753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea1ae1-e9fb-4600-9c0b-2483f07f7e4a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:23.495101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea1ae1-e9fb-4600-9c0b-2483f07f7e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:23.536421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8fea1ae1-e9fb-4600-9c0b-2483f07f7e4a None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:23.540452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:23.541110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8fea1ae1-e9fb-4600-9c0b-2483f07f7e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:23.707631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faf071-666b-4c2a-8ac7-970baeeaddea None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:23.727663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68b9c8-aaff-4b4c-97a1-bcb78a24c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:23.728535 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68b9c8-aaff-4b4c-97a1-bcb78a24c504 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:23.732343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68b9c8-aaff-4b4c-97a1-bcb78a24c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:23.732343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68b9c8-aaff-4b4c-97a1-bcb78a24c504 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:23.735551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68b9c8-aaff-4b4c-97a1-bcb78a24c504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:23.744432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68b9c8-aaff-4b4c-97a1-bcb78a24c504 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:23.799149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 876/1745] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 12:57:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:23.812051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 870/1746] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:23 2022] POST /identity/v3/users => generated 289 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:23.816127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea1ae1-e9fb-4600-9c0b-2483f07f7e4a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:23.835936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea1ae1-e9fb-4600-9c0b-2483f07f7e4a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:23.850300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf20f5-10f6-4242-9fb1-19e44e9edfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:23.851403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf20f5-10f6-4242-9fb1-19e44e9edfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:23.851403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf20f5-10f6-4242-9fb1-19e44e9edfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:23.851752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf20f5-10f6-4242-9fb1-19e44e9edfa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:23.852613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf20f5-10f6-4242-9fb1-19e44e9edfa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:23.855685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf20f5-10f6-4242-9fb1-19e44e9edfa0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:23.877538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1908d-7584-473c-9e52-1b24061e5a17 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:23.877971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1908d-7584-473c-9e52-1b24061e5a17 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:23.878338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1908d-7584-473c-9e52-1b24061e5a17 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:23.880610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 871/1747] 10.222.0.48 () {54 vars in 960 bytes} [Fri Jun 17 12:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 12:57:23.887254 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb098e92-63bf-4f27-91f5-d990836bf2cc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:23.887547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb098e92-63bf-4f27-91f5-d990836bf2cc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:23.887816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb098e92-63bf-4f27-91f5-d990836bf2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:23.919758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 877/1748] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:23.920861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf20f5-10f6-4242-9fb1-19e44e9edfa0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:23.949502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bb098e92-63bf-4f27-91f5-d990836bf2cc None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:23.950842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bb098e92-63bf-4f27-91f5-d990836bf2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:23.955743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf20f5-10f6-4242-9fb1-19e44e9edfa0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:23.975407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af81ee-bb8c-4918-903a-862facac7174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:23.976525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af81ee-bb8c-4918-903a-862facac7174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:23.976871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af81ee-bb8c-4918-903a-862facac7174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:23.977154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af81ee-bb8c-4918-903a-862facac7174 admin admin] PATH_INFO: `/v3/projects/b1c3e0fc333b4b7cacb0b0a4ef9d06b3/users/8d58643e712b457ca3c5974dc8b94fd3/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:23.982324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 872/1749] 10.222.0.48 () {58 vars in 1057 bytes} [Fri Jun 17 12:57:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:23.991569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb098e92-63bf-4f27-91f5-d990836bf2cc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:24.012208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb098e92-63bf-4f27-91f5-d990836bf2cc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:24.029430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f59c2-7e0c-4a40-a144-e25eed459467 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:24.031109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f59c2-7e0c-4a40-a144-e25eed459467 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:24.031574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f59c2-7e0c-4a40-a144-e25eed459467 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:24.032309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af81ee-bb8c-4918-903a-862facac7174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c3e0fc333b4b7cacb0b0a4ef9d06b3, user_id=8d58643e712b457ca3c5974dc8b94fd3, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:24.032821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f59c2-7e0c-4a40-a144-e25eed459467 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:24.038441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af81ee-bb8c-4918-903a-862facac7174 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:24.056503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f59c2-7e0c-4a40-a144-e25eed459467 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:24.063281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f59c2-7e0c-4a40-a144-e25eed459467 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:24.069655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 878/1750] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:23 2022] PUT /identity/v3/projects/b1c3e0fc333b4b7cacb0b0a4ef9d06b3/users/8d58643e712b457ca3c5974dc8b94fd3/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:24.071017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af81ee-bb8c-4918-903a-862facac7174 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:24.097491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 873/1751] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:24.182880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:24.248062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af81ee-bb8c-4918-903a-862facac7174 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:24.265440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46216b6b-734a-4e1a-9e7c-557905f98e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:24.266283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46216b6b-734a-4e1a-9e7c-557905f98e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:24.266567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46216b6b-734a-4e1a-9e7c-557905f98e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:24.266840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46216b6b-734a-4e1a-9e7c-557905f98e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:24.267618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46216b6b-734a-4e1a-9e7c-557905f98e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:24.269334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46216b6b-734a-4e1a-9e7c-557905f98e82 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:24.301161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 879/1752] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:24.309307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f59c2-7e0c-4a40-a144-e25eed459467 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:24.378046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f59c2-7e0c-4a40-a144-e25eed459467 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:24.422313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91005b-2378-4165-8c75-835e82a3a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:24.424297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91005b-2378-4165-8c75-835e82a3a0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:24.427954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91005b-2378-4165-8c75-835e82a3a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:24.429666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91005b-2378-4165-8c75-835e82a3a0a2 admin admin] PATH_INFO: `/v3/projects/b1c3e0fc333b4b7cacb0b0a4ef9d06b3/users/8d58643e712b457ca3c5974dc8b94fd3/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:24.441781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91005b-2378-4165-8c75-835e82a3a0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c3e0fc333b4b7cacb0b0a4ef9d06b3, user_id=8d58643e712b457ca3c5974dc8b94fd3, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:24.450549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91005b-2378-4165-8c75-835e82a3a0a2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:24.487012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 874/1753] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:24 2022] PUT /identity/v3/projects/b1c3e0fc333b4b7cacb0b0a4ef9d06b3/users/8d58643e712b457ca3c5974dc8b94fd3/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:24.509895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47273c4-6f15-4f01-bcdf-589e8066a459 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:24.510220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47273c4-6f15-4f01-bcdf-589e8066a459 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:24.510500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47273c4-6f15-4f01-bcdf-589e8066a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:24.594582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e47273c4-6f15-4f01-bcdf-589e8066a459 None None] MFA Rules not processed for user `8d58643e712b457ca3c5974dc8b94fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:24.595855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e47273c4-6f15-4f01-bcdf-589e8066a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:24.755509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 880/1754] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:24.770401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91005b-2378-4165-8c75-835e82a3a0a2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:24.772109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f91005b-2378-4165-8c75-835e82a3a0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:24.919166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91005b-2378-4165-8c75-835e82a3a0a2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:24.927732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80deb19-a50d-40b2-8182-aa2d5797172b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:24.928435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80deb19-a50d-40b2-8182-aa2d5797172b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:24.928714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80deb19-a50d-40b2-8182-aa2d5797172b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:24.928994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80deb19-a50d-40b2-8182-aa2d5797172b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:24.952043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80deb19-a50d-40b2-8182-aa2d5797172b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:24.957815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80deb19-a50d-40b2-8182-aa2d5797172b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:24.993090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 875/1755] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:25.097510 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb6cc4-2480-47bf-88b9-2159c8626ba0 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:25.099182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb6cc4-2480-47bf-88b9-2159c8626ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:25.099659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb6cc4-2480-47bf-88b9-2159c8626ba0 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:25.101724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 881/1756] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 17 12:57:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:57:25.116081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f3e0e-079a-476d-8cd8-419806b3ac43 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:25.116611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f3e0e-079a-476d-8cd8-419806b3ac43 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:25.117191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f3e0e-079a-476d-8cd8-419806b3ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:25.210440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-336f3e0e-079a-476d-8cd8-419806b3ac43 None None] MFA Rules not processed for user `688ecef411094633927ffd663ffa1818`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:25.219799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-336f3e0e-079a-476d-8cd8-419806b3ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:25.221533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb6cc4-2480-47bf-88b9-2159c8626ba0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:25.240567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb6cc4-2480-47bf-88b9-2159c8626ba0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:25.257403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7473550-2131-4253-a741-fb50cf090eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:25.258182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7473550-2131-4253-a741-fb50cf090eaf service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:25.258399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7473550-2131-4253-a741-fb50cf090eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:25.258672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7473550-2131-4253-a741-fb50cf090eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:25.448561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 876/1757] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:25.503460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7473550-2131-4253-a741-fb50cf090eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:25.505263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7473550-2131-4253-a741-fb50cf090eaf service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:25.546962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 882/1758] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:25 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:57:25.549131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8ffb0-587c-4599-945b-37b3d5589ad9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:25.549425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8ffb0-587c-4599-945b-37b3d5589ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:25.549861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8ffb0-587c-4599-945b-37b3d5589ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:25.567581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7473550-2131-4253-a741-fb50cf090eaf service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:25.569454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b7473550-2131-4253-a741-fb50cf090eaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:25.602252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7473550-2131-4253-a741-fb50cf090eaf service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:25.610735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fbf90-f2b9-4f45-a41a-dbdfc3242cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:25.611899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fbf90-f2b9-4f45-a41a-dbdfc3242cca service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:25.612320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fbf90-f2b9-4f45-a41a-dbdfc3242cca service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:25.612751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fbf90-f2b9-4f45-a41a-dbdfc3242cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:25.617084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-80e8ffb0-587c-4599-945b-37b3d5589ad9 None None] MFA Rules not processed for user `e2d0edf9b51d4370950f7ff503c324b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:25.618783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-80e8ffb0-587c-4599-945b-37b3d5589ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:25.630990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:25.631253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fbf90-f2b9-4f45-a41a-dbdfc3242cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:25.633314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fbf90-f2b9-4f45-a41a-dbdfc3242cca service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:25.663339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 883/1759] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:25.732088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 877/1760] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:25.756557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834993bd-4077-47d1-b3ec-a11aea0d490b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:25.756849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834993bd-4077-47d1-b3ec-a11aea0d490b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:25.757209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834993bd-4077-47d1-b3ec-a11aea0d490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:25.804573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-834993bd-4077-47d1-b3ec-a11aea0d490b None None] MFA Rules not processed for user `e2d0edf9b51d4370950f7ff503c324b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:25.809241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-834993bd-4077-47d1-b3ec-a11aea0d490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:25.830632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 884/1761] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:25.855582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8ffb0-587c-4599-945b-37b3d5589ad9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:25.857141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-80e8ffb0-587c-4599-945b-37b3d5589ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:26.095152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8ffb0-587c-4599-945b-37b3d5589ad9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:26.118029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3da21a-7cbf-4ca4-8c34-353d068986df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:26.119218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3da21a-7cbf-4ca4-8c34-353d068986df service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:26.119691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3da21a-7cbf-4ca4-8c34-353d068986df service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:26.120113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3da21a-7cbf-4ca4-8c34-353d068986df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:26.174784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3da21a-7cbf-4ca4-8c34-353d068986df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:26.177255 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3da21a-7cbf-4ca4-8c34-353d068986df service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:26.212692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 878/1762] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:26.850539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834993bd-4077-47d1-b3ec-a11aea0d490b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:26.852938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-834993bd-4077-47d1-b3ec-a11aea0d490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:26.912677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3da21a-7cbf-4ca4-8c34-353d068986df service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:26.921084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ec3da21a-7cbf-4ca4-8c34-353d068986df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:27.063445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:27.311014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834993bd-4077-47d1-b3ec-a11aea0d490b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:27.361306 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:27.364393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:27.369543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:27.371850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] PATH_INFO: `/v3/projects/1daf2fdb07624a4bbb341ae0a27a0a5f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:27.381087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1daf2fdb07624a4bbb341ae0a27a0a5f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:27.396236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3da21a-7cbf-4ca4-8c34-353d068986df service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:27.396590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:27.436794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:27.438486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:27.439096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:27.439435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] PATH_INFO: `/v3/users/99957cda2d554185b2e75215c412608a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:27.454325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99957cda2d554185b2e75215c412608a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:27.458025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:27.579516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:27.603588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1daf2fdb07624a4bbb341ae0a27a0a5f', 'request_id': 'req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.620973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1daf2fdb07624a4bbb341ae0a27a0a5f', 'request_id': 'req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.621818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99957cda2d554185b2e75215c412608a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.639654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1daf2fdb07624a4bbb341ae0a27a0a5f', 'request_id': 'req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.672135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99957cda2d554185b2e75215c412608a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.673299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99957cda2d554185b2e75215c412608a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.680916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] The token cache is being invalidate because project 1daf2fdb07624a4bbb341ae0a27a0a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:27.680916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.682171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c72cd33f-2f95-4f67-9a86-fccaa6ee982a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.687520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 885/1763] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:26 2022] DELETE /identity/v3/projects/1daf2fdb07624a4bbb341ae0a27a0a5f => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:27.688302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99957cda2d554185b2e75215c412608a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.694583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917817-6d47-4ac7-9446-842d1a1566e7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:27.694950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917817-6d47-4ac7-9446-842d1a1566e7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:27.695400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917817-6d47-4ac7-9446-842d1a1566e7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:27.702565 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 886/1764] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 17 12:57:27 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:57:27.707549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8917817-6d47-4ac7-9446-842d1a1566e7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:27.710928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-50baccd6-d076-4331-8328-8eae27b7e3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99957cda2d554185b2e75215c412608a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:27.711046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a8917817-6d47-4ac7-9446-842d1a1566e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:27.723663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 879/1765] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:26 2022] DELETE /identity/v3/users/99957cda2d554185b2e75215c412608a => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:27.723663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917bcc4-44ed-488f-9049-308c9cd5cd86 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:27.723663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917bcc4-44ed-488f-9049-308c9cd5cd86 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:27.723663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917bcc4-44ed-488f-9049-308c9cd5cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:27.773778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2917bcc4-44ed-488f-9049-308c9cd5cd86 None None] MFA Rules not processed for user `688ecef411094633927ffd663ffa1818`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:27.777596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2917bcc4-44ed-488f-9049-308c9cd5cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:27.938732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8917817-6d47-4ac7-9446-842d1a1566e7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:27.962307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:27.966296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:27.970226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:27.970658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] PATH_INFO: `/v3/users/e8363916825445c292402e86079df571` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:27.973266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8363916825445c292402e86079df571)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:27.977681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:27.985944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 880/1766] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:27.987958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917bcc4-44ed-488f-9049-308c9cd5cd86 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:27.991907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2917bcc4-44ed-488f-9049-308c9cd5cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:28.105982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8363916825445c292402e86079df571'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.108385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8363916825445c292402e86079df571'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.111916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8363916825445c292402e86079df571'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.133107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8363916825445c292402e86079df571'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.151309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8363916825445c292402e86079df571'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.160575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:28.185635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917bcc4-44ed-488f-9049-308c9cd5cd86 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:28.192365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8445d-a52b-43ec-b1de-79de10613521 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:28.193330 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8445d-a52b-43ec-b1de-79de10613521 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:28.193747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8445d-a52b-43ec-b1de-79de10613521 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:28.194125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8445d-a52b-43ec-b1de-79de10613521 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:28.196688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87b8445d-a52b-43ec-b1de-79de10613521 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:28.198053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 887/1767] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:27 2022] DELETE /identity/v3/users/e8363916825445c292402e86079df571 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:28.202273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:28.203344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:28.216893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8445d-a52b-43ec-b1de-79de10613521 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:28.219810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8445d-a52b-43ec-b1de-79de10613521 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:28.244362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 881/1768] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:28.247624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc2b6a-7950-4c89-9843-9d92c4a1cf0d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:28.247826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc2b6a-7950-4c89-9843-9d92c4a1cf0d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:28.248213 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc2b6a-7950-4c89-9843-9d92c4a1cf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:28.343962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b79031-ba4c-4b51-a3c0-8482e2b41a86 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:28.345403 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f6dc2b6a-7950-4c89-9843-9d92c4a1cf0d None None] MFA Rules not processed for user `b75243e37f2342c0a428d39e193e0d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:28.350165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f6dc2b6a-7950-4c89-9843-9d92c4a1cf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:28.351890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:28.352723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:28.353114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:28.353493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:28.357121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:28.380876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:28.384595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:28.411129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 888/1769] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:28.416878 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:28.423279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:28.512880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:28.546365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 882/1770] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:28.566977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc2b6a-7950-4c89-9843-9d92c4a1cf0d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:28.569679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f6dc2b6a-7950-4c89-9843-9d92c4a1cf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:28.625054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c754a2-6711-43f6-bf4a-5861ef79ac4a service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:28.641641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:28.642732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:28.643086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:28.643441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] PATH_INFO: `/v3/projects/022134f6c19b496fb3c6932cd2c716b9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:28.647522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] RBAC: Authorizing `identity:delete_project(project_id=022134f6c19b496fb3c6932cd2c716b9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:28.649775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:28.795606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022134f6c19b496fb3c6932cd2c716b9', 'request_id': 'req-f3717008-37d8-4fdf-9e8e-bb43a15b182d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.798433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc2b6a-7950-4c89-9843-9d92c4a1cf0d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:28.811441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022134f6c19b496fb3c6932cd2c716b9', 'request_id': 'req-f3717008-37d8-4fdf-9e8e-bb43a15b182d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.836303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022134f6c19b496fb3c6932cd2c716b9', 'request_id': 'req-f3717008-37d8-4fdf-9e8e-bb43a15b182d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.853936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] The token cache is being invalidate because project 022134f6c19b496fb3c6932cd2c716b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:28.854478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.855362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:28.857219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 889/1771] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:28 2022] DELETE /identity/v3/projects/022134f6c19b496fb3c6932cd2c716b9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:28.862579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:28.867606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:28.901494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:28.997190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3717008-37d8-4fdf-9e8e-bb43a15b182d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:29.013108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:29.015965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:29.016892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:29.017732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] PATH_INFO: `/v3/users/7b3204b081784f8e98940cffb799b8d8` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:29.021739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3204b081784f8e98940cffb799b8d8)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:29.025827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:29.027451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:29.027946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:29.028803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] PATH_INFO: `/v3/projects/7fe195bd8f314c1d8262e110962a5ff4` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:29.034123 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:29.034579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe195bd8f314c1d8262e110962a5ff4)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:29.051584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:29.263461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3204b081784f8e98940cffb799b8d8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.264617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3204b081784f8e98940cffb799b8d8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.266382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3204b081784f8e98940cffb799b8d8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.268080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe195bd8f314c1d8262e110962a5ff4', 'request_id': 'req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.274723 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe195bd8f314c1d8262e110962a5ff4', 'request_id': 'req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.282629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe195bd8f314c1d8262e110962a5ff4', 'request_id': 'req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.287285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3204b081784f8e98940cffb799b8d8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.304501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] The token cache is being invalidate because project 7fe195bd8f314c1d8262e110962a5ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:29.304983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.306065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582fa4a6-9e92-47a6-bec1-f0bf3c7ccf96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.309409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 883/1772] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:28 2022] DELETE /identity/v3/projects/7fe195bd8f314c1d8262e110962a5ff4 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:29.313626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490fe0a-34d4-4888-b485-0a6f85b83cff None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:29.314552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490fe0a-34d4-4888-b485-0a6f85b83cff None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:29.315275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490fe0a-34d4-4888-b485-0a6f85b83cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:29.317897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3204b081784f8e98940cffb799b8d8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:29.345132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1490fe0a-34d4-4888-b485-0a6f85b83cff None None] MFA Rules not processed for user `8bfbd9324f8040c496a83eb599ca80c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:29.348143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1490fe0a-34d4-4888-b485-0a6f85b83cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:29.367446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 890/1773] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:28 2022] DELETE /identity/v3/users/7b3204b081784f8e98940cffb799b8d8 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:29.368525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:29.375023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:29.427295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:29.544263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 884/1774] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:29.637812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aae2f-e872-4e84-80bc-fbb344690a71 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:29.657117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:29.658030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:29.658343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:29.658631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] PATH_INFO: `/v3/users/1cf6bf5aeed7459884386bd54bc60d52` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:29.665295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf6bf5aeed7459884386bd54bc60d52)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:29.667803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:29.724703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490fe0a-34d4-4888-b485-0a6f85b83cff None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:29.730985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1490fe0a-34d4-4888-b485-0a6f85b83cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:29.964717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:30.008244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf6bf5aeed7459884386bd54bc60d52'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.012135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf6bf5aeed7459884386bd54bc60d52'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.025187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf6bf5aeed7459884386bd54bc60d52'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.054274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490fe0a-34d4-4888-b485-0a6f85b83cff None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:30.061169 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:30.062648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:30.062966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:30.063216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] PATH_INFO: `/v3/projects/6e3b90d3d8f04bdba57150b733b9ad73` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:30.064803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3b90d3d8f04bdba57150b733b9ad73)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:30.066779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:30.088349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf6bf5aeed7459884386bd54bc60d52'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.112148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf6bf5aeed7459884386bd54bc60d52'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.158144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 891/1775] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:29 2022] DELETE /identity/v3/users/1cf6bf5aeed7459884386bd54bc60d52 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:30.160011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:30.171149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:30.243707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3b90d3d8f04bdba57150b733b9ad73', 'request_id': 'req-e53c128f-146c-4c4b-9957-beae5f94b04e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.253028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3b90d3d8f04bdba57150b733b9ad73', 'request_id': 'req-e53c128f-146c-4c4b-9957-beae5f94b04e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.263736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3b90d3d8f04bdba57150b733b9ad73', 'request_id': 'req-e53c128f-146c-4c4b-9957-beae5f94b04e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.289296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] The token cache is being invalidate because project 6e3b90d3d8f04bdba57150b733b9ad73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:30.289954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.291038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e53c128f-146c-4c4b-9957-beae5f94b04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:30.294944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 885/1776] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:29 2022] DELETE /identity/v3/projects/6e3b90d3d8f04bdba57150b733b9ad73 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:30.298273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5cd2-278a-4cca-99d0-466837a4d24e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:30.298820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5cd2-278a-4cca-99d0-466837a4d24e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:30.299233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b5cd2-278a-4cca-99d0-466837a4d24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:30.356345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5d4b5cd2-278a-4cca-99d0-466837a4d24e None None] MFA Rules not processed for user `847c39439e874e68b72e07c311a53bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:30.360147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5d4b5cd2-278a-4cca-99d0-466837a4d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:30.617752 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 886/1777] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:30.619395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba46df-3f98-4279-a5cb-9d2ae7863c9c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:30.619695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba46df-3f98-4279-a5cb-9d2ae7863c9c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:30.619979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba46df-3f98-4279-a5cb-9d2ae7863c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:30.648983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e971096-88eb-41d9-a4ca-09e4a2d250d1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:30.669448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c3ba46df-3f98-4279-a5cb-9d2ae7863c9c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:30.678810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c3ba46df-3f98-4279-a5cb-9d2ae7863c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:30.695495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:30.902590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:30.904780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:30.906916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:30.907614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] PATH_INFO: `/v3/users/e640d93c66fa4419af6cc0fedaf54cc3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:30.911188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e640d93c66fa4419af6cc0fedaf54cc3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:30.918479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:30.928069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 887/1778] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:30.930999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba46df-3f98-4279-a5cb-9d2ae7863c9c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:30.934856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c3ba46df-3f98-4279-a5cb-9d2ae7863c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:31.001792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba46df-3f98-4279-a5cb-9d2ae7863c9c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:31.020021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:31.020940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:31.021237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:31.021672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] PATH_INFO: `/v3/projects/5764603e92ef44cabc923dbc15ba8545` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:31.023519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5764603e92ef44cabc923dbc15ba8545)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:31.030517 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:31.190631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e640d93c66fa4419af6cc0fedaf54cc3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.194934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5764603e92ef44cabc923dbc15ba8545', 'request_id': 'req-bf5b532a-761a-4f87-a83d-4f4a91005010'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.196632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e640d93c66fa4419af6cc0fedaf54cc3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.199346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e640d93c66fa4419af6cc0fedaf54cc3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.203606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5764603e92ef44cabc923dbc15ba8545', 'request_id': 'req-bf5b532a-761a-4f87-a83d-4f4a91005010'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.228153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5764603e92ef44cabc923dbc15ba8545', 'request_id': 'req-bf5b532a-761a-4f87-a83d-4f4a91005010'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.239865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e640d93c66fa4419af6cc0fedaf54cc3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.258882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e640d93c66fa4419af6cc0fedaf54cc3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.262813 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:31.268932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] The token cache is being invalidate because project 5764603e92ef44cabc923dbc15ba8545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:31.269283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.285166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bf5b532a-761a-4f87-a83d-4f4a91005010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.292959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 888/1779] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:30 2022] DELETE /identity/v3/projects/5764603e92ef44cabc923dbc15ba8545 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:31.299563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35025-489d-4663-8b44-ad8f50165367 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:31.307186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35025-489d-4663-8b44-ad8f50165367 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:31.308302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35025-489d-4663-8b44-ad8f50165367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:31.324468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 892/1780] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:30 2022] DELETE /identity/v3/users/e640d93c66fa4419af6cc0fedaf54cc3 => generated 0 bytes in 1166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:31.329455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:31.331142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:31.395287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fbf35025-489d-4663-8b44-ad8f50165367 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:31.397464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fbf35025-489d-4663-8b44-ad8f50165367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:31.580930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495fbfc-8d25-49ba-b092-55608a42426f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:31.594188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:31.595138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:31.595381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:31.595660 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] PATH_INFO: `/v3/projects/67152be85f894148973edbc5ff0c50fe` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:31.598960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67152be85f894148973edbc5ff0c50fe)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:31.602532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:31.658219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 889/1781] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:31.660700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6d7ff-3def-4152-95b5-43b4adca1984 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:31.660969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6d7ff-3def-4152-95b5-43b4adca1984 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:31.661257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6d7ff-3def-4152-95b5-43b4adca1984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:31.697473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-85d6d7ff-3def-4152-95b5-43b4adca1984 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:31.699020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-85d6d7ff-3def-4152-95b5-43b4adca1984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:31.727929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67152be85f894148973edbc5ff0c50fe', 'request_id': 'req-56b73d5f-9069-4f59-acdd-64083e437942'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.736794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67152be85f894148973edbc5ff0c50fe', 'request_id': 'req-56b73d5f-9069-4f59-acdd-64083e437942'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.759525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67152be85f894148973edbc5ff0c50fe', 'request_id': 'req-56b73d5f-9069-4f59-acdd-64083e437942'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.793743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:31.806974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] The token cache is being invalidate because project 67152be85f894148973edbc5ff0c50fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:31.808211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.812520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-56b73d5f-9069-4f59-acdd-64083e437942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:31.819658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 893/1782] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:31 2022] DELETE /identity/v3/projects/67152be85f894148973edbc5ff0c50fe => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:31.819658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a6bb-1997-455d-b6ac-c47be5147753 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:31.820668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a6bb-1997-455d-b6ac-c47be5147753 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:31.820668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a6bb-1997-455d-b6ac-c47be5147753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:31.876199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 890/1783] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:31.880446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6d7ff-3def-4152-95b5-43b4adca1984 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:31.887025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-85d6d7ff-3def-4152-95b5-43b4adca1984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:31.924020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6d7ff-3def-4152-95b5-43b4adca1984 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:31.940909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cc04b-2369-4bbb-8279-4de545622b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:31.941652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cc04b-2369-4bbb-8279-4de545622b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:31.941951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cc04b-2369-4bbb-8279-4de545622b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:31.942290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cc04b-2369-4bbb-8279-4de545622b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:31.943082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cc04b-2369-4bbb-8279-4de545622b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:31.943409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cc04b-2369-4bbb-8279-4de545622b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:31.945126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cc04b-2369-4bbb-8279-4de545622b3f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:31.993182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 891/1784] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:31.994663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41137515-efbd-4a8f-88e3-f06bfc7741e1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:31.995185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41137515-efbd-4a8f-88e3-f06bfc7741e1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:31.995344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41137515-efbd-4a8f-88e3-f06bfc7741e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.042470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-41137515-efbd-4a8f-88e3-f06bfc7741e1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:32.043941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-41137515-efbd-4a8f-88e3-f06bfc7741e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:32.074054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 892/1785] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:32.076301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61ffe7-8763-4cd0-8b70-f36ef3dcf5c1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.077960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61ffe7-8763-4cd0-8b70-f36ef3dcf5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.077960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61ffe7-8763-4cd0-8b70-f36ef3dcf5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.136187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5e61ffe7-8763-4cd0-8b70-f36ef3dcf5c1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:32.138966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5e61ffe7-8763-4cd0-8b70-f36ef3dcf5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:32.178707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 893/1786] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:32.180597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61ffe7-8763-4cd0-8b70-f36ef3dcf5c1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:32.213689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61ffe7-8763-4cd0-8b70-f36ef3dcf5c1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:32.228229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728218a-7ba6-44b2-9da6-74e16aeca765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:32.229014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728218a-7ba6-44b2-9da6-74e16aeca765 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.229527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728218a-7ba6-44b2-9da6-74e16aeca765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.229527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728218a-7ba6-44b2-9da6-74e16aeca765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.230233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728218a-7ba6-44b2-9da6-74e16aeca765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:32.232394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728218a-7ba6-44b2-9da6-74e16aeca765 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:32.251584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a9e9a6bb-1997-455d-b6ac-c47be5147753 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:32.255101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a9e9a6bb-1997-455d-b6ac-c47be5147753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:32.281495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 894/1787] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:32.290569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe4eec-5ffc-463e-8870-8769d627aaa1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.291980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe4eec-5ffc-463e-8870-8769d627aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.292401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe4eec-5ffc-463e-8870-8769d627aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.302068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 894/1788] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:32 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:32.303138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728218a-7ba6-44b2-9da6-74e16aeca765 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:32.341640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ccbe4eec-5ffc-463e-8870-8769d627aaa1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:32.345282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ccbe4eec-5ffc-463e-8870-8769d627aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:32.483926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728218a-7ba6-44b2-9da6-74e16aeca765 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:32.509431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 895/1789] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:32.512928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:32.512928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.512928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.512928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.514429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe4eec-5ffc-463e-8870-8769d627aaa1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:32.515149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:32.515684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:32.519162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:32.526644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe4eec-5ffc-463e-8870-8769d627aaa1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:32.532775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d76c7-efa7-48e8-9962-ced0d6f82207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:32.533871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d76c7-efa7-48e8-9962-ced0d6f82207 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.534405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d76c7-efa7-48e8-9962-ced0d6f82207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.534819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d76c7-efa7-48e8-9962-ced0d6f82207 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.535882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d76c7-efa7-48e8-9962-ced0d6f82207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:32.549112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 895/1790] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:32.550188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:32.552824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d76c7-efa7-48e8-9962-ced0d6f82207 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:32.555883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:32.570195 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:32.602369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 896/1791] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:32 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:32.604944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d76c7-efa7-48e8-9962-ced0d6f82207 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:32.628423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d76c7-efa7-48e8-9962-ced0d6f82207 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:32.633995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8c9d-6a04-4c36-8984-73c9b8fbfa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:32.636372 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8c9d-6a04-4c36-8984-73c9b8fbfa7c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.636687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8c9d-6a04-4c36-8984-73c9b8fbfa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.636964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8c9d-6a04-4c36-8984-73c9b8fbfa7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.637942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8c9d-6a04-4c36-8984-73c9b8fbfa7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:32.638335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8c9d-6a04-4c36-8984-73c9b8fbfa7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:32.640107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8c9d-6a04-4c36-8984-73c9b8fbfa7c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:32.657063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 897/1792] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:32.661814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8c9d-6a04-4c36-8984-73c9b8fbfa7c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:32.675790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343339a-37a2-49d8-a8c6-5f0338f05210 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:32.676047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8c9d-6a04-4c36-8984-73c9b8fbfa7c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:32.680394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861b097-9109-442b-9de2-8a5352249dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:32.681177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861b097-9109-442b-9de2-8a5352249dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.681522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861b097-9109-442b-9de2-8a5352249dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.681917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861b097-9109-442b-9de2-8a5352249dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.688999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e7d4c-3966-457c-b5fc-8120e1a08837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:32.689708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e7d4c-3966-457c-b5fc-8120e1a08837 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.690049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e7d4c-3966-457c-b5fc-8120e1a08837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.690359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e7d4c-3966-457c-b5fc-8120e1a08837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.691075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e7d4c-3966-457c-b5fc-8120e1a08837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:32.693100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e7d4c-3966-457c-b5fc-8120e1a08837 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:32.693614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861b097-9109-442b-9de2-8a5352249dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:32.695370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861b097-9109-442b-9de2-8a5352249dd2 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:32.722580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 896/1793] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:32.723635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861b097-9109-442b-9de2-8a5352249dd2 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:32.764153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861b097-9109-442b-9de2-8a5352249dd2 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:32.776860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 898/1794] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:32 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:32.778324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e7d4c-3966-457c-b5fc-8120e1a08837 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:32.784788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879145fa-f149-43d2-a0f4-39f901d0b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:32.786056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879145fa-f149-43d2-a0f4-39f901d0b6de admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.786699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879145fa-f149-43d2-a0f4-39f901d0b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.789013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879145fa-f149-43d2-a0f4-39f901d0b6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.792328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879145fa-f149-43d2-a0f4-39f901d0b6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:32.800355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879145fa-f149-43d2-a0f4-39f901d0b6de admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:32.845136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 897/1795] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:32.847027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879145fa-f149-43d2-a0f4-39f901d0b6de admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:32.898285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879145fa-f149-43d2-a0f4-39f901d0b6de admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:32.906547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e7d4c-3966-457c-b5fc-8120e1a08837 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:32.917237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8d539-89fb-4408-9a12-2eb7d2980f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:32.918501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8d539-89fb-4408-9a12-2eb7d2980f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.919105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8d539-89fb-4408-9a12-2eb7d2980f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.919707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8d539-89fb-4408-9a12-2eb7d2980f8a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.928644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8d539-89fb-4408-9a12-2eb7d2980f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:32.929173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbb1a0-484b-4c48-b8d5-489dac563371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:32.929173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb1a0-484b-4c48-b8d5-489dac563371 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:32.929173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb1a0-484b-4c48-b8d5-489dac563371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:32.929173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb1a0-484b-4c48-b8d5-489dac563371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:32.929466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbb1a0-484b-4c48-b8d5-489dac563371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:32.929680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbb1a0-484b-4c48-b8d5-489dac563371 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:32.933450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8d539-89fb-4408-9a12-2eb7d2980f8a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:32.979020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:33.008043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 899/1796] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:32 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:33.015277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b679c4-3ab8-4ebc-a09a-a293f2ad83b4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:33.016594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b679c4-3ab8-4ebc-a09a-a293f2ad83b4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:33.016881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b679c4-3ab8-4ebc-a09a-a293f2ad83b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:33.028416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 898/1797] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:32 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:33.028416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8d539-89fb-4408-9a12-2eb7d2980f8a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:33.054366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8d539-89fb-4408-9a12-2eb7d2980f8a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:33.063383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-30b679c4-3ab8-4ebc-a09a-a293f2ad83b4 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:33.065722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-30b679c4-3ab8-4ebc-a09a-a293f2ad83b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:33.169831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf3116-00ae-48b4-b656-74213d1d6c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:33.171541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf3116-00ae-48b4-b656-74213d1d6c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:33.171840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf3116-00ae-48b4-b656-74213d1d6c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:33.172491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf3116-00ae-48b4-b656-74213d1d6c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:33.173480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf3116-00ae-48b4-b656-74213d1d6c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:33.177167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf3116-00ae-48b4-b656-74213d1d6c72 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:33.192606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 899/1798] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:33.193636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf3116-00ae-48b4-b656-74213d1d6c72 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:33.212533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf3116-00ae-48b4-b656-74213d1d6c72 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:33.219475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c9c7e-37d1-48ec-9346-3dc67bc1576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:33.220872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c9c7e-37d1-48ec-9346-3dc67bc1576a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:33.221069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c9c7e-37d1-48ec-9346-3dc67bc1576a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:33.221485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c9c7e-37d1-48ec-9346-3dc67bc1576a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:33.222581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c9c7e-37d1-48ec-9346-3dc67bc1576a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:33.226308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c9c7e-37d1-48ec-9346-3dc67bc1576a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:33.273026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 900/1799] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:33 2022] POST /identity/v3/users => generated 294 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:33.282812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c9c7e-37d1-48ec-9346-3dc67bc1576a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:33.315013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c9c7e-37d1-48ec-9346-3dc67bc1576a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:33.334856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f16249-a2db-4377-81eb-dd458193a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:33.335690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f16249-a2db-4377-81eb-dd458193a6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:33.336050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f16249-a2db-4377-81eb-dd458193a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:33.336392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f16249-a2db-4377-81eb-dd458193a6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:33.337491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f16249-a2db-4377-81eb-dd458193a6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:33.339371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f16249-a2db-4377-81eb-dd458193a6e2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:33.366689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 901/1800] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:33.369631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f16249-a2db-4377-81eb-dd458193a6e2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:33.375004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 900/1801] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 12:57:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:33.387046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b679c4-3ab8-4ebc-a09a-a293f2ad83b4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:33.418580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f16249-a2db-4377-81eb-dd458193a6e2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:33.419749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b679c4-3ab8-4ebc-a09a-a293f2ad83b4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:33.429176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1df21-a615-49ed-9c93-c3954b0108cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:33.430948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1df21-a615-49ed-9c93-c3954b0108cf admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:33.431616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1df21-a615-49ed-9c93-c3954b0108cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:33.432577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1df21-a615-49ed-9c93-c3954b0108cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:33.434370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1df21-a615-49ed-9c93-c3954b0108cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:33.437756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f625e00-109a-46b8-b962-487e711b565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:33.440251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1df21-a615-49ed-9c93-c3954b0108cf admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:33.441491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f625e00-109a-46b8-b962-487e711b565c admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:33.443512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f625e00-109a-46b8-b962-487e711b565c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:33.445380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f625e00-109a-46b8-b962-487e711b565c admin admin] PATH_INFO: `/v3/projects/9de7aaf88af741dd84a557799308b743/users/c54fbb17c23b429d85fea5c266ccdaad/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:33.476836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 901/1802] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:33.478375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1df21-a615-49ed-9c93-c3954b0108cf admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:33.507176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1df21-a615-49ed-9c93-c3954b0108cf admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:33.513798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f625e00-109a-46b8-b962-487e711b565c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de7aaf88af741dd84a557799308b743, user_id=c54fbb17c23b429d85fea5c266ccdaad, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:33.526885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f625e00-109a-46b8-b962-487e711b565c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:33.537689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134af123-b43c-4819-846f-c5f434a037ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:33.538862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134af123-b43c-4819-846f-c5f434a037ee admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:33.539343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134af123-b43c-4819-846f-c5f434a037ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:33.543439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134af123-b43c-4819-846f-c5f434a037ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:33.553213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134af123-b43c-4819-846f-c5f434a037ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:33.560791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 902/1803] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:33 2022] PUT /identity/v3/projects/9de7aaf88af741dd84a557799308b743/users/c54fbb17c23b429d85fea5c266ccdaad/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:33.564487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134af123-b43c-4819-846f-c5f434a037ee admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:33.567282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f625e00-109a-46b8-b962-487e711b565c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:33.626192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 902/1804] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:33.633169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebeee5-6482-46ec-9cac-6e3196139246 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:33.635811 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebeee5-6482-46ec-9cac-6e3196139246 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:33.636175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebeee5-6482-46ec-9cac-6e3196139246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:33.772865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-27ebeee5-6482-46ec-9cac-6e3196139246 None None] MFA Rules not processed for user `c54fbb17c23b429d85fea5c266ccdaad`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:33.784867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-27ebeee5-6482-46ec-9cac-6e3196139246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:33.837325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:33.845210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f625e00-109a-46b8-b962-487e711b565c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:33.862538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40050fe9-9fd0-4166-8adf-ceb1e40719e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:33.863783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050fe9-9fd0-4166-8adf-ceb1e40719e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:33.864277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050fe9-9fd0-4166-8adf-ceb1e40719e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:33.864751 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40050fe9-9fd0-4166-8adf-ceb1e40719e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:33.865786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40050fe9-9fd0-4166-8adf-ceb1e40719e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:33.875508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40050fe9-9fd0-4166-8adf-ceb1e40719e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:33.924781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 903/1805] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:33.926863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40050fe9-9fd0-4166-8adf-ceb1e40719e1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:33.936979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-40050fe9-9fd0-4166-8adf-ceb1e40719e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:34.001110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 903/1806] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:34.004572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebeee5-6482-46ec-9cac-6e3196139246 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:34.036111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebeee5-6482-46ec-9cac-6e3196139246 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:34.049534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7db5a-c7f8-4d4f-96db-5e637c7a4670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:34.051251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7db5a-c7f8-4d4f-96db-5e637c7a4670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:34.051538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7db5a-c7f8-4d4f-96db-5e637c7a4670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:34.052421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7db5a-c7f8-4d4f-96db-5e637c7a4670 admin admin] PATH_INFO: `/v3/projects/2bf250ae8eb641f9bc47184c21dc1f6c/users/72e85bdaf3444f0ca3d5a84def5ccf88/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:34.111998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7db5a-c7f8-4d4f-96db-5e637c7a4670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf250ae8eb641f9bc47184c21dc1f6c, user_id=72e85bdaf3444f0ca3d5a84def5ccf88, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:34.114892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7db5a-c7f8-4d4f-96db-5e637c7a4670 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:34.124892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:34.174398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 904/1807] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:34 2022] PUT /identity/v3/projects/2bf250ae8eb641f9bc47184c21dc1f6c/users/72e85bdaf3444f0ca3d5a84def5ccf88/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:34.175586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7db5a-c7f8-4d4f-96db-5e637c7a4670 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:34.291369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40050fe9-9fd0-4166-8adf-ceb1e40719e1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:34.421092 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7db5a-c7f8-4d4f-96db-5e637c7a4670 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:34.444246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88be141-05eb-4e59-9c97-d890162c0abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:34.450590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88be141-05eb-4e59-9c97-d890162c0abe admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:34.452198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88be141-05eb-4e59-9c97-d890162c0abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:34.453285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88be141-05eb-4e59-9c97-d890162c0abe admin admin] PATH_INFO: `/v3/projects/3356466068b64ababaee82a9b237829a/users/82da53a6b7854424b403e084dce837bc/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:34.572196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88be141-05eb-4e59-9c97-d890162c0abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3356466068b64ababaee82a9b237829a, user_id=82da53a6b7854424b403e084dce837bc, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:34.597002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88be141-05eb-4e59-9c97-d890162c0abe admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:34.666829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 905/1808] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:34 2022] PUT /identity/v3/projects/3356466068b64ababaee82a9b237829a/users/82da53a6b7854424b403e084dce837bc/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:34.676913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88be141-05eb-4e59-9c97-d890162c0abe admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:34.682554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f4a6a-3ba1-420a-adaf-20f83d44590a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:34.687265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f4a6a-3ba1-420a-adaf-20f83d44590a service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:34.689063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f4a6a-3ba1-420a-adaf-20f83d44590a service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:34.689931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f4a6a-3ba1-420a-adaf-20f83d44590a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:34.896541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88be141-05eb-4e59-9c97-d890162c0abe admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:34.910967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f4a6a-3ba1-420a-adaf-20f83d44590a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:34.916930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f4a6a-3ba1-420a-adaf-20f83d44590a service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:34.925848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad955f-e05f-4800-b9c3-56e4b8d8ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:34.931492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad955f-e05f-4800-b9c3-56e4b8d8ff1e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:34.932093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad955f-e05f-4800-b9c3-56e4b8d8ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:34.935130 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad955f-e05f-4800-b9c3-56e4b8d8ff1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:34.936768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad955f-e05f-4800-b9c3-56e4b8d8ff1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:34.947832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad955f-e05f-4800-b9c3-56e4b8d8ff1e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:34.961706 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 904/1809] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 12:57:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1036 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 12:57:34.963318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0780-3302-415b-ad2c-733e4ea7cdc9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:34.963606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0780-3302-415b-ad2c-733e4ea7cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:34.963889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0780-3302-415b-ad2c-733e4ea7cdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:35.051629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:35.087240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 906/1810] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:34 2022] POST /identity/v3/projects => generated 385 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:35.089675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2a4ea-23da-4019-85b8-73de43a7772f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:35.090502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2a4ea-23da-4019-85b8-73de43a7772f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:35.091064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2a4ea-23da-4019-85b8-73de43a7772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:35.113871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-319b0780-3302-415b-ad2c-733e4ea7cdc9 None None] MFA Rules not processed for user `72e85bdaf3444f0ca3d5a84def5ccf88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:35.115151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-319b0780-3302-415b-ad2c-733e4ea7cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:35.139951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-56d2a4ea-23da-4019-85b8-73de43a7772f None None] MFA Rules not processed for user `82da53a6b7854424b403e084dce837bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:35.142216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-56d2a4ea-23da-4019-85b8-73de43a7772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:35.251680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 907/1811] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:35.253437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2a4ea-23da-4019-85b8-73de43a7772f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:35.268007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 905/1812] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:35.269795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0780-3302-415b-ad2c-733e4ea7cdc9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:35.285810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:35.386281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2a4ea-23da-4019-85b8-73de43a7772f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:35.398804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d14f4-0f9a-4eba-9161-490b74020e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:35.400691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d14f4-0f9a-4eba-9161-490b74020e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:35.402160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d14f4-0f9a-4eba-9161-490b74020e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:35.403540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d14f4-0f9a-4eba-9161-490b74020e69 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:35.405520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d14f4-0f9a-4eba-9161-490b74020e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:35.412011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d14f4-0f9a-4eba-9161-490b74020e69 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:35.490305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 908/1813] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:35 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:35.491599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d14f4-0f9a-4eba-9161-490b74020e69 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:35.517982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d14f4-0f9a-4eba-9161-490b74020e69 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:35.555097 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b159a4-dbe0-42fd-bcaa-c14637cf7b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:35.557425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b159a4-dbe0-42fd-bcaa-c14637cf7b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:35.558914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b159a4-dbe0-42fd-bcaa-c14637cf7b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:35.561100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b159a4-dbe0-42fd-bcaa-c14637cf7b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:35.563070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b159a4-dbe0-42fd-bcaa-c14637cf7b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:35.569271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b159a4-dbe0-42fd-bcaa-c14637cf7b90 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:35.609680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0780-3302-415b-ad2c-733e4ea7cdc9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:35.648541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd051-274c-400e-9440-34193eeb07b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:35.649402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd051-274c-400e-9440-34193eeb07b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:35.649689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd051-274c-400e-9440-34193eeb07b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:35.650009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd051-274c-400e-9440-34193eeb07b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:35.653804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 909/1814] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:35 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:35.655495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b159a4-dbe0-42fd-bcaa-c14637cf7b90 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:35.655725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd051-274c-400e-9440-34193eeb07b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:35.677171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd051-274c-400e-9440-34193eeb07b9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:35.851913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:35.858762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 906/1815] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:35 2022] POST /identity/v3/projects => generated 389 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:35.859870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd051-274c-400e-9440-34193eeb07b9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:35.930787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b159a4-dbe0-42fd-bcaa-c14637cf7b90 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:36.102950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd051-274c-400e-9440-34193eeb07b9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:36.110823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26288c-a23d-4080-a77f-4f94d0795978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:36.112202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26288c-a23d-4080-a77f-4f94d0795978 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.112665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26288c-a23d-4080-a77f-4f94d0795978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.113139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26288c-a23d-4080-a77f-4f94d0795978 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.114849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26288c-a23d-4080-a77f-4f94d0795978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:36.125035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26288c-a23d-4080-a77f-4f94d0795978 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:36.179407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356b689-a2db-49ea-a759-d7e1a12d61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:36.180812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356b689-a2db-49ea-a759-d7e1a12d61a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.181121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356b689-a2db-49ea-a759-d7e1a12d61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.181422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356b689-a2db-49ea-a759-d7e1a12d61a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.182444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356b689-a2db-49ea-a759-d7e1a12d61a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:36.185300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356b689-a2db-49ea-a759-d7e1a12d61a9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:36.198535 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 907/1816] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:35 2022] POST /identity/v3/users => generated 297 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:36.199841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26288c-a23d-4080-a77f-4f94d0795978 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:36.217702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 910/1817] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:36.219719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356b689-a2db-49ea-a759-d7e1a12d61a9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:36.221856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6356b689-a2db-49ea-a759-d7e1a12d61a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:36.242464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26288c-a23d-4080-a77f-4f94d0795978 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:36.250931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356b689-a2db-49ea-a759-d7e1a12d61a9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:36.257405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b573b0-86cf-484e-83c7-c26516a18103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:36.259528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b573b0-86cf-484e-83c7-c26516a18103 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.260630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b573b0-86cf-484e-83c7-c26516a18103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.260630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b573b0-86cf-484e-83c7-c26516a18103 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.260827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b573b0-86cf-484e-83c7-c26516a18103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:36.262818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b573b0-86cf-484e-83c7-c26516a18103 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:36.266628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:36.267658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.267947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.268223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] PATH_INFO: `/v3/projects/fa052b1e5c5a495cb2d8ab6b522832d5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.269694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa052b1e5c5a495cb2d8ab6b522832d5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:36.277201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:36.361238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 908/1818] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:36 2022] POST /identity/v3/users => generated 301 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:36.378119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aafd16-9917-49c7-8eae-8aa381dc6b31 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.378119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aafd16-9917-49c7-8eae-8aa381dc6b31 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.378119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aafd16-9917-49c7-8eae-8aa381dc6b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.437692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a5aafd16-9917-49c7-8eae-8aa381dc6b31 None None] MFA Rules not processed for user `688ecef411094633927ffd663ffa1818`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:36.438965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a5aafd16-9917-49c7-8eae-8aa381dc6b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:36.472460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa052b1e5c5a495cb2d8ab6b522832d5', 'request_id': 'req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:36.489375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa052b1e5c5a495cb2d8ab6b522832d5', 'request_id': 'req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:36.508239 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa052b1e5c5a495cb2d8ab6b522832d5', 'request_id': 'req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:36.531628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] The token cache is being invalidate because project fa052b1e5c5a495cb2d8ab6b522832d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:36.532794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:36.533594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:36.537879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 911/1819] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:36 2022] DELETE /identity/v3/projects/fa052b1e5c5a495cb2d8ab6b522832d5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:36.546238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:36.549831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:36.586304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 909/1820] 10.222.0.75 () {58 vars in 1015 bytes} [Fri Jun 17 12:57:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:36.587884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aafd16-9917-49c7-8eae-8aa381dc6b31 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:36.589585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a5aafd16-9917-49c7-8eae-8aa381dc6b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:36.647188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:36.697273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1da09-69c4-4fe2-90ea-18e702dd9e5e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:36.745688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8cb35-482a-4a96-b301-27dd61cdcc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:36.746432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8cb35-482a-4a96-b301-27dd61cdcc1b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.746718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8cb35-482a-4a96-b301-27dd61cdcc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.750287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8cb35-482a-4a96-b301-27dd61cdcc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.751789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8cb35-482a-4a96-b301-27dd61cdcc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:36.756643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8cb35-482a-4a96-b301-27dd61cdcc1b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:36.770648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 912/1821] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:36.772847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8cb35-482a-4a96-b301-27dd61cdcc1b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:36.774826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f7c8cb35-482a-4a96-b301-27dd61cdcc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:36.790576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aafd16-9917-49c7-8eae-8aa381dc6b31 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:36.791537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8cb35-482a-4a96-b301-27dd61cdcc1b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:36.796128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f6154-a2f0-41ee-bc43-11ff66fca8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:36.797794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f6154-a2f0-41ee-bc43-11ff66fca8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.798308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f6154-a2f0-41ee-bc43-11ff66fca8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.798624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a435-e337-4319-95d4-23e0f0fb6a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:36.798965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f6154-a2f0-41ee-bc43-11ff66fca8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.799529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a435-e337-4319-95d4-23e0f0fb6a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.799963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a435-e337-4319-95d4-23e0f0fb6a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.800394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a435-e337-4319-95d4-23e0f0fb6a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.801045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f6154-a2f0-41ee-bc43-11ff66fca8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:36.801582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76a435-e337-4319-95d4-23e0f0fb6a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:36.803428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f6154-a2f0-41ee-bc43-11ff66fca8ff admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:36.804132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76a435-e337-4319-95d4-23e0f0fb6a56 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:36.828831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 913/1822] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:36.829871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a435-e337-4319-95d4-23e0f0fb6a56 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:36.831845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5b76a435-e337-4319-95d4-23e0f0fb6a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:36.839780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 910/1823] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:36.840596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f6154-a2f0-41ee-bc43-11ff66fca8ff admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:36.847345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:36.856421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a435-e337-4319-95d4-23e0f0fb6a56 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:36.864182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:36.864975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f6154-a2f0-41ee-bc43-11ff66fca8ff admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:36.865263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.866113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.866390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] PATH_INFO: `/v3/users/8d58643e712b457ca3c5974dc8b94fd3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.867862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d58643e712b457ca3c5974dc8b94fd3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:36.870478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:36.878472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d4cec-4af2-41e5-b4a9-ba1d3c7f4252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:36.881955 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4cec-4af2-41e5-b4a9-ba1d3c7f4252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:36.882425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4cec-4af2-41e5-b4a9-ba1d3c7f4252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:36.882871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d4cec-4af2-41e5-b4a9-ba1d3c7f4252 admin admin] PATH_INFO: `/v3/projects/b6141d126bd444c09338d935d782650f/users/a9ce8c1cc579417aa7bdad5ef2037d88/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:36.927663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d4cec-4af2-41e5-b4a9-ba1d3c7f4252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6141d126bd444c09338d935d782650f, user_id=a9ce8c1cc579417aa7bdad5ef2037d88, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:36.930454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d4cec-4af2-41e5-b4a9-ba1d3c7f4252 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:36.966433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 911/1824] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:36 2022] PUT /identity/v3/projects/b6141d126bd444c09338d935d782650f/users/a9ce8c1cc579417aa7bdad5ef2037d88/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:36.967076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d4cec-4af2-41e5-b4a9-ba1d3c7f4252 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:36.970038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d58643e712b457ca3c5974dc8b94fd3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:36.970895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d58643e712b457ca3c5974dc8b94fd3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:36.971578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d58643e712b457ca3c5974dc8b94fd3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:37.021319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d58643e712b457ca3c5974dc8b94fd3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:37.034291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d58643e712b457ca3c5974dc8b94fd3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:37.091958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 914/1825] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:36 2022] DELETE /identity/v3/users/8d58643e712b457ca3c5974dc8b94fd3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:37.091958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:37.094382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:37.165975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d4cec-4af2-41e5-b4a9-ba1d3c7f4252 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:37.214492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29c0a1-52e2-4bfe-83aa-e350e178cc25 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:37.238027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09872f1-698a-4df3-86fb-893bf690ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:37.239300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09872f1-698a-4df3-86fb-893bf690ca02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:37.239573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09872f1-698a-4df3-86fb-893bf690ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:37.239874 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09872f1-698a-4df3-86fb-893bf690ca02 admin admin] PATH_INFO: `/v3/projects/636b811749ed49d9a8743835952e727b/users/d16520e6b5674cbead65f1882caaee0c/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:37.263946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982ab30-bb18-464e-958a-d3605714c0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:37.265881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982ab30-bb18-464e-958a-d3605714c0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:37.266953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982ab30-bb18-464e-958a-d3605714c0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:37.268374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982ab30-bb18-464e-958a-d3605714c0ab admin admin] PATH_INFO: `/v3/projects/8f194603402f405f8b9f706c02c6f435/users/eb3f2246e08f45c0aaa1603e893ce71c/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:37.292224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982ab30-bb18-464e-958a-d3605714c0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f194603402f405f8b9f706c02c6f435, user_id=eb3f2246e08f45c0aaa1603e893ce71c, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:37.293634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09872f1-698a-4df3-86fb-893bf690ca02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636b811749ed49d9a8743835952e727b, user_id=d16520e6b5674cbead65f1882caaee0c, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:37.297629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982ab30-bb18-464e-958a-d3605714c0ab admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:37.324637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 912/1826] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:36 2022] PUT /identity/v3/projects/8f194603402f405f8b9f706c02c6f435/users/eb3f2246e08f45c0aaa1603e893ce71c/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:37.325681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09872f1-698a-4df3-86fb-893bf690ca02 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:37.325883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982ab30-bb18-464e-958a-d3605714c0ab admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:37.328202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6982ab30-bb18-464e-958a-d3605714c0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:37.361932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 915/1827] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:37 2022] PUT /identity/v3/projects/636b811749ed49d9a8743835952e727b/users/d16520e6b5674cbead65f1882caaee0c/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:37.363463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09872f1-698a-4df3-86fb-893bf690ca02 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:37.370479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b09872f1-698a-4df3-86fb-893bf690ca02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:37.382741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:37.572229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982ab30-bb18-464e-958a-d3605714c0ab admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:37.641116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09872f1-698a-4df3-86fb-893bf690ca02 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:37.656636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb66b1-0915-42ec-be6b-bd18953e5216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:37.657501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb66b1-0915-42ec-be6b-bd18953e5216 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:37.657848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb66b1-0915-42ec-be6b-bd18953e5216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:37.658218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb66b1-0915-42ec-be6b-bd18953e5216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:37.659041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb66b1-0915-42ec-be6b-bd18953e5216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:37.661607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb66b1-0915-42ec-be6b-bd18953e5216 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:37.665325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:37.687849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 916/1828] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:37.689288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3371e7a-0bf0-46cf-8fa5-46811c726e2f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:37.690373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3371e7a-0bf0-46cf-8fa5-46811c726e2f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:37.693678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3371e7a-0bf0-46cf-8fa5-46811c726e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:37.751732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b3371e7a-0bf0-46cf-8fa5-46811c726e2f None None] MFA Rules not processed for user `d16520e6b5674cbead65f1882caaee0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:37.751958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02ce32-0d40-4c8a-ba55-06ee3a25a4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:37.752670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02ce32-0d40-4c8a-ba55-06ee3a25a4dc admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:37.755274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02ce32-0d40-4c8a-ba55-06ee3a25a4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:37.755588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02ce32-0d40-4c8a-ba55-06ee3a25a4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:37.756428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02ce32-0d40-4c8a-ba55-06ee3a25a4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:37.756727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b3371e7a-0bf0-46cf-8fa5-46811c726e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:37.785860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02ce32-0d40-4c8a-ba55-06ee3a25a4dc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:37.865300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 913/1829] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:37.867652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02ce32-0d40-4c8a-ba55-06ee3a25a4dc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:37.914319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02ce32-0d40-4c8a-ba55-06ee3a25a4dc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:37.932843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc072976-800a-40bc-a566-b5482cc591ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:37.933609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc072976-800a-40bc-a566-b5482cc591ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:37.933798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc072976-800a-40bc-a566-b5482cc591ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:37.934143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc072976-800a-40bc-a566-b5482cc591ef admin admin] PATH_INFO: `/v3/projects/8f194603402f405f8b9f706c02c6f435/users/eb3f2246e08f45c0aaa1603e893ce71c/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:37.939774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 917/1830] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:37.941391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc072976-800a-40bc-a566-b5482cc591ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f194603402f405f8b9f706c02c6f435, user_id=eb3f2246e08f45c0aaa1603e893ce71c, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:37.949527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc072976-800a-40bc-a566-b5482cc591ef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:37.952297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3371e7a-0bf0-46cf-8fa5-46811c726e2f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:37.975757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3371e7a-0bf0-46cf-8fa5-46811c726e2f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:37.995021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 914/1831] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:37 2022] PUT /identity/v3/projects/8f194603402f405f8b9f706c02c6f435/users/eb3f2246e08f45c0aaa1603e893ce71c/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:38.013851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc072976-800a-40bc-a566-b5482cc591ef admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:38.019285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bc072976-800a-40bc-a566-b5482cc591ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:38.152100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb57f8-c4b0-46ec-b862-7d1bf2051e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:38.152951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb57f8-c4b0-46ec-b862-7d1bf2051e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:38.163826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb57f8-c4b0-46ec-b862-7d1bf2051e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:38.171875 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb57f8-c4b0-46ec-b862-7d1bf2051e1e admin admin] PATH_INFO: `/v3/projects/b6141d126bd444c09338d935d782650f/users/a9ce8c1cc579417aa7bdad5ef2037d88/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:38.176670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb57f8-c4b0-46ec-b862-7d1bf2051e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6141d126bd444c09338d935d782650f, user_id=a9ce8c1cc579417aa7bdad5ef2037d88, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:38.184043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb57f8-c4b0-46ec-b862-7d1bf2051e1e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:38.210220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 918/1832] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:37 2022] PUT /identity/v3/projects/b6141d126bd444c09338d935d782650f/users/a9ce8c1cc579417aa7bdad5ef2037d88/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:38.211208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb57f8-c4b0-46ec-b862-7d1bf2051e1e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:38.216818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-afeb57f8-c4b0-46ec-b862-7d1bf2051e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:38.254686 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc072976-800a-40bc-a566-b5482cc591ef admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:38.494411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388912a-bc30-4d38-9c28-250ffdbc7410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:38.499373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388912a-bc30-4d38-9c28-250ffdbc7410 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:38.500992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388912a-bc30-4d38-9c28-250ffdbc7410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:38.502174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388912a-bc30-4d38-9c28-250ffdbc7410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:38.509827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb57f8-c4b0-46ec-b862-7d1bf2051e1e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:38.510596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f388912a-bc30-4d38-9c28-250ffdbc7410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:38.534892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:38.537237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:38.538106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:38.540791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] PATH_INFO: `/v3/projects/b1c3e0fc333b4b7cacb0b0a4ef9d06b3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:38.542042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388912a-bc30-4d38-9c28-250ffdbc7410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:38.546727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c3e0fc333b4b7cacb0b0a4ef9d06b3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:38.548169 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388912a-bc30-4d38-9c28-250ffdbc7410 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:38.562246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:38.586450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 915/1833] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:38.587899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388912a-bc30-4d38-9c28-250ffdbc7410 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:38.617836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388912a-bc30-4d38-9c28-250ffdbc7410 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:38.625159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100902f5-7636-435e-89f1-62aacb338d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:38.625870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100902f5-7636-435e-89f1-62aacb338d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:38.626244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100902f5-7636-435e-89f1-62aacb338d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:38.626521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100902f5-7636-435e-89f1-62aacb338d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:38.629208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100902f5-7636-435e-89f1-62aacb338d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:38.634773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100902f5-7636-435e-89f1-62aacb338d0b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:38.645101 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:38.663006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:38.722822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 916/1834] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:38 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:38.724972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46803780-1a86-458e-a6df-aeeeef0b1ae4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:38.725515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46803780-1a86-458e-a6df-aeeeef0b1ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:38.725876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46803780-1a86-458e-a6df-aeeeef0b1ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:38.730947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c3e0fc333b4b7cacb0b0a4ef9d06b3', 'request_id': 'req-6ffcdc4b-bd64-4632-b812-5095aff25ff7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:38.750750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c3e0fc333b4b7cacb0b0a4ef9d06b3', 'request_id': 'req-6ffcdc4b-bd64-4632-b812-5095aff25ff7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:38.768036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c3e0fc333b4b7cacb0b0a4ef9d06b3', 'request_id': 'req-6ffcdc4b-bd64-4632-b812-5095aff25ff7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:38.770238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-46803780-1a86-458e-a6df-aeeeef0b1ae4 None None] MFA Rules not processed for user `eb3f2246e08f45c0aaa1603e893ce71c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:38.774349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-46803780-1a86-458e-a6df-aeeeef0b1ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:38.803857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] The token cache is being invalidate because project b1c3e0fc333b4b7cacb0b0a4ef9d06b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:38.803857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:38.803857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ffcdc4b-bd64-4632-b812-5095aff25ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:38.803857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 919/1835] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:38 2022] DELETE /identity/v3/projects/b1c3e0fc333b4b7cacb0b0a4ef9d06b3 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:38.805466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fb59f-2c3f-4728-a850-57fab2864ad4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:38.807140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fb59f-2c3f-4728-a850-57fab2864ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:38.807524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fb59f-2c3f-4728-a850-57fab2864ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:38.886399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-444fb59f-2c3f-4728-a850-57fab2864ad4 None None] MFA Rules not processed for user `a9ce8c1cc579417aa7bdad5ef2037d88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:38.888131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-444fb59f-2c3f-4728-a850-57fab2864ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:38.944974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 917/1836] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:38.946227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46803780-1a86-458e-a6df-aeeeef0b1ae4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:38.949976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-46803780-1a86-458e-a6df-aeeeef0b1ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:39.061208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46803780-1a86-458e-a6df-aeeeef0b1ae4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:39.078617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acfd4-9815-438c-a334-7d55ef2e01f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:39.079761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acfd4-9815-438c-a334-7d55ef2e01f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.080292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acfd4-9815-438c-a334-7d55ef2e01f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.080414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 920/1837] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:39.081891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6138e3-842f-4926-8417-4ce26e39492a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.083635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11acfd4-9815-438c-a334-7d55ef2e01f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.084745 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11acfd4-9815-438c-a334-7d55ef2e01f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:39.087151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6138e3-842f-4926-8417-4ce26e39492a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.087591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6138e3-842f-4926-8417-4ce26e39492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.090149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11acfd4-9815-438c-a334-7d55ef2e01f8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:39.148518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 918/1838] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:38 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:39.150440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acfd4-9815-438c-a334-7d55ef2e01f8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:39.153892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9b6138e3-842f-4926-8417-4ce26e39492a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:39.157597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f11acfd4-9815-438c-a334-7d55ef2e01f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:39.158509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9b6138e3-842f-4926-8417-4ce26e39492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:39.191988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 921/1839] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:39.195437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6138e3-842f-4926-8417-4ce26e39492a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:39.205140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9b6138e3-842f-4926-8417-4ce26e39492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:39.354495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6138e3-842f-4926-8417-4ce26e39492a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:39.359223 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11acfd4-9815-438c-a334-7d55ef2e01f8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:39.359683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ebfb-5620-4548-b5be-d8849b8510d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:39.360419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ebfb-5620-4548-b5be-d8849b8510d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.360705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ebfb-5620-4548-b5be-d8849b8510d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.361023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ebfb-5620-4548-b5be-d8849b8510d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.375102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219ebfb-5620-4548-b5be-d8849b8510d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:39.379480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219ebfb-5620-4548-b5be-d8849b8510d2 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:39.381181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11283f-1fd1-4083-86a5-016c846dc98c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:39.382144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11283f-1fd1-4083-86a5-016c846dc98c service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.385475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11283f-1fd1-4083-86a5-016c846dc98c service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.386212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11283f-1fd1-4083-86a5-016c846dc98c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.396745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 922/1840] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:39.398641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ebfb-5620-4548-b5be-d8849b8510d2 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:39.412009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ebfb-5620-4548-b5be-d8849b8510d2 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:39.436125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11283f-1fd1-4083-86a5-016c846dc98c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:39.436955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5240b9-6e96-42a5-bc76-4d75a8ef2427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:39.439464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5240b9-6e96-42a5-bc76-4d75a8ef2427 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.439966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5240b9-6e96-42a5-bc76-4d75a8ef2427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.440855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5240b9-6e96-42a5-bc76-4d75a8ef2427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.442274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11283f-1fd1-4083-86a5-016c846dc98c service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:39.443229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5240b9-6e96-42a5-bc76-4d75a8ef2427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:39.448820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5240b9-6e96-42a5-bc76-4d75a8ef2427 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:39.480041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 919/1841] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:39.484617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 923/1842] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:39.498040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ee9a3-19ae-4a12-859d-06ad992385ed None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.498495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ee9a3-19ae-4a12-859d-06ad992385ed None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.499531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ee9a3-19ae-4a12-859d-06ad992385ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.506407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11283f-1fd1-4083-86a5-016c846dc98c service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:39.552628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:39.574866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11283f-1fd1-4083-86a5-016c846dc98c service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:39.579107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ad0ee9a3-19ae-4a12-859d-06ad992385ed None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:39.587380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ad0ee9a3-19ae-4a12-859d-06ad992385ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:39.607146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 924/1843] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:39.614330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ee9a3-19ae-4a12-859d-06ad992385ed None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:39.629648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a0db4-edf5-45ec-aa60-998b2eddc8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:39.631138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ee9a3-19ae-4a12-859d-06ad992385ed None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:39.633529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a0db4-edf5-45ec-aa60-998b2eddc8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.635573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a0db4-edf5-45ec-aa60-998b2eddc8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.638032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632454f5-7d0d-4d5c-82e6-6d13159dbdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:39.638338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a0db4-edf5-45ec-aa60-998b2eddc8bd admin admin] PATH_INFO: `/v3/projects/7585fdca4505496a9086fc37b65cf9d0/users/1b422260998c484db7fa650e973ad3d0/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.639231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632454f5-7d0d-4d5c-82e6-6d13159dbdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.639758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632454f5-7d0d-4d5c-82e6-6d13159dbdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.640392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632454f5-7d0d-4d5c-82e6-6d13159dbdb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.641524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632454f5-7d0d-4d5c-82e6-6d13159dbdb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:39.642222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632454f5-7d0d-4d5c-82e6-6d13159dbdb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:39.644919 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632454f5-7d0d-4d5c-82e6-6d13159dbdb4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:39.669965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:39.678702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 925/1844] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:39.680580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632454f5-7d0d-4d5c-82e6-6d13159dbdb4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:39.708622 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a0db4-edf5-45ec-aa60-998b2eddc8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7585fdca4505496a9086fc37b65cf9d0, user_id=1b422260998c484db7fa650e973ad3d0, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:39.713114 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a0db4-edf5-45ec-aa60-998b2eddc8bd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:39.750664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 920/1845] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:39 2022] PUT /identity/v3/projects/7585fdca4505496a9086fc37b65cf9d0/users/1b422260998c484db7fa650e973ad3d0/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:39.753583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a0db4-edf5-45ec-aa60-998b2eddc8bd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:39.754169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632454f5-7d0d-4d5c-82e6-6d13159dbdb4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:39.909279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19a74-2dff-4a47-a519-f3c5c6326e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:39.912282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19a74-2dff-4a47-a519-f3c5c6326e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.913188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19a74-2dff-4a47-a519-f3c5c6326e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.913996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19a74-2dff-4a47-a519-f3c5c6326e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.915913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f19a74-2dff-4a47-a519-f3c5c6326e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:39.921026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f19a74-2dff-4a47-a519-f3c5c6326e59 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:39.941445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a0db4-edf5-45ec-aa60-998b2eddc8bd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:39.955808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:39.956830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:39.957452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:39.957813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:39.963646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:40.006169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 926/1846] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:39 2022] POST /identity/v3/projects => generated 387 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:40.008051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19a74-2dff-4a47-a519-f3c5c6326e59 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:40.175210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:40.184603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:40.226139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 921/1847] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:40.226139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:40.226139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:40.230866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19a74-2dff-4a47-a519-f3c5c6326e59 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:40.258865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b6a10-212e-499e-8700-27c47035ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:40.260421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b6a10-212e-499e-8700-27c47035ad1a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:40.260708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b6a10-212e-499e-8700-27c47035ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:40.261114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b6a10-212e-499e-8700-27c47035ad1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:40.262015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b6a10-212e-499e-8700-27c47035ad1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:40.281994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b6a10-212e-499e-8700-27c47035ad1a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:40.285769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b52491-97d8-4464-a332-a57f807af2df service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:40.297788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 927/1848] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:40.298810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b6a10-212e-499e-8700-27c47035ad1a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:40.309104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:40.310054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:40.312635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:40.313135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] PATH_INFO: `/v3/users/82da53a6b7854424b403e084dce837bc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:40.322169 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=82da53a6b7854424b403e084dce837bc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:40.324674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:40.337078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b6a10-212e-499e-8700-27c47035ad1a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:40.354753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078db4c-f3aa-434d-b4da-0e23e84ceec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:40.356073 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078db4c-f3aa-434d-b4da-0e23e84ceec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:40.356363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078db4c-f3aa-434d-b4da-0e23e84ceec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:40.356634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078db4c-f3aa-434d-b4da-0e23e84ceec5 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:40.357371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078db4c-f3aa-434d-b4da-0e23e84ceec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:40.359556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078db4c-f3aa-434d-b4da-0e23e84ceec5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:40.477523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 928/1849] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:40 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:40.486976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078db4c-f3aa-434d-b4da-0e23e84ceec5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:40.536742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82da53a6b7854424b403e084dce837bc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:40.546138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078db4c-f3aa-434d-b4da-0e23e84ceec5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:40.561851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab690e-8a7a-4e14-80ca-93f832c50217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:40.564831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab690e-8a7a-4e14-80ca-93f832c50217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:40.565175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab690e-8a7a-4e14-80ca-93f832c50217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:40.565464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab690e-8a7a-4e14-80ca-93f832c50217 admin admin] PATH_INFO: `/v3/projects/7585fdca4505496a9086fc37b65cf9d0/users/1b422260998c484db7fa650e973ad3d0/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:40.583043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82da53a6b7854424b403e084dce837bc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:40.585350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82da53a6b7854424b403e084dce837bc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:40.586924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab690e-8a7a-4e14-80ca-93f832c50217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7585fdca4505496a9086fc37b65cf9d0, user_id=1b422260998c484db7fa650e973ad3d0, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:40.600304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab690e-8a7a-4e14-80ca-93f832c50217 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:40.627307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82da53a6b7854424b403e084dce837bc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:40.649071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82da53a6b7854424b403e084dce837bc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:40.669647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 922/1850] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:40 2022] DELETE /identity/v3/users/82da53a6b7854424b403e084dce837bc => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:40.671028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:40.674979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:40.689502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 929/1851] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:40 2022] PUT /identity/v3/projects/7585fdca4505496a9086fc37b65cf9d0/users/1b422260998c484db7fa650e973ad3d0/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:40.695753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c742149-2196-4a05-8dec-836ac5ae4290 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:40.696602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:40.697138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c742149-2196-4a05-8dec-836ac5ae4290 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:40.705852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c742149-2196-4a05-8dec-836ac5ae4290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:40.805706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7c742149-2196-4a05-8dec-836ac5ae4290 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:40.808719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c742149-2196-4a05-8dec-836ac5ae4290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:40.874454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982feca-b131-47ae-b7a3-aeb46c0b1ddd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:40.886622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 930/1852] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:40.890159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607e815-7c7f-41b0-842e-d4081ff13952 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:40.890488 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607e815-7c7f-41b0-842e-d4081ff13952 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:40.892178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607e815-7c7f-41b0-842e-d4081ff13952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:40.912886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb0439-04e3-49ec-b67b-6edafd490884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:40.913512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb0439-04e3-49ec-b67b-6edafd490884 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:40.916412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb0439-04e3-49ec-b67b-6edafd490884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:40.916805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb0439-04e3-49ec-b67b-6edafd490884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:40.917627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb0439-04e3-49ec-b67b-6edafd490884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:40.923577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb0439-04e3-49ec-b67b-6edafd490884 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:40.953943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 923/1853] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:40.955552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb0439-04e3-49ec-b67b-6edafd490884 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:40.957137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a607e815-7c7f-41b0-842e-d4081ff13952 None None] MFA Rules not processed for user `1b422260998c484db7fa650e973ad3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:40.964234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a607e815-7c7f-41b0-842e-d4081ff13952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:40.978556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb0439-04e3-49ec-b67b-6edafd490884 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:40.991402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe4b46-8128-4527-9dd3-a6af0265c0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:40.992117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe4b46-8128-4527-9dd3-a6af0265c0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:40.992433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe4b46-8128-4527-9dd3-a6af0265c0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:40.992670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe4b46-8128-4527-9dd3-a6af0265c0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:40.993585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe4b46-8128-4527-9dd3-a6af0265c0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:40.995312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe4b46-8128-4527-9dd3-a6af0265c0bc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:41.021467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 924/1854] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:41.023967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe4b46-8128-4527-9dd3-a6af0265c0bc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:41.046909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe4b46-8128-4527-9dd3-a6af0265c0bc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:41.054941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc92f-9953-4fd4-84dc-e9ec180d26c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:41.056018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc92f-9953-4fd4-84dc-e9ec180d26c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:41.056300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc92f-9953-4fd4-84dc-e9ec180d26c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:41.056608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecc92f-9953-4fd4-84dc-e9ec180d26c5 admin admin] PATH_INFO: `/v3/projects/26d9429fca264a68866a1de6f21eeb25/users/b53561a9950f44d3b3de373421feac11/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:41.082339 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecc92f-9953-4fd4-84dc-e9ec180d26c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d9429fca264a68866a1de6f21eeb25, user_id=b53561a9950f44d3b3de373421feac11, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:41.084753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:41.089183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecc92f-9953-4fd4-84dc-e9ec180d26c5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:41.139305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 925/1855] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:41 2022] PUT /identity/v3/projects/26d9429fca264a68866a1de6f21eeb25/users/b53561a9950f44d3b3de373421feac11/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:41.140543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc92f-9953-4fd4-84dc-e9ec180d26c5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:41.144467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5fecc92f-9953-4fd4-84dc-e9ec180d26c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:41.216913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 931/1856] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:41.237204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed0e5-2a74-4f01-bde4-9e74118a3e0c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:41.238381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed0e5-2a74-4f01-bde4-9e74118a3e0c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:41.238687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed0e5-2a74-4f01-bde4-9e74118a3e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:41.347082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecc92f-9953-4fd4-84dc-e9ec180d26c5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:41.357712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c37fd3-6542-4d4c-b7a0-e6c2a543d91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:41.359253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c37fd3-6542-4d4c-b7a0-e6c2a543d91f service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:41.359552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c37fd3-6542-4d4c-b7a0-e6c2a543d91f service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:41.359863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c37fd3-6542-4d4c-b7a0-e6c2a543d91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:41.362737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c90ed0e5-2a74-4f01-bde4-9e74118a3e0c None None] MFA Rules not processed for user `b53561a9950f44d3b3de373421feac11`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:41.364055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c90ed0e5-2a74-4f01-bde4-9e74118a3e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:41.587134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 932/1857] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:41.588922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed0e5-2a74-4f01-bde4-9e74118a3e0c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:41.599560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c90ed0e5-2a74-4f01-bde4-9e74118a3e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:41.625521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c37fd3-6542-4d4c-b7a0-e6c2a543d91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:41.627103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c37fd3-6542-4d4c-b7a0-e6c2a543d91f service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:41.649520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 926/1858] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:41.650417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c37fd3-6542-4d4c-b7a0-e6c2a543d91f service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:41.679495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c37fd3-6542-4d4c-b7a0-e6c2a543d91f service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:41.715821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625b9b-33f4-4786-9208-35443b51e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:41.716507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625b9b-33f4-4786-9208-35443b51e89f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:41.716796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625b9b-33f4-4786-9208-35443b51e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:41.717144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17625b9b-33f4-4786-9208-35443b51e89f admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:41.717869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17625b9b-33f4-4786-9208-35443b51e89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:41.719972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17625b9b-33f4-4786-9208-35443b51e89f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:41.756467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:41.785628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 927/1859] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:41 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:41.789504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625b9b-33f4-4786-9208-35443b51e89f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:41.843235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed0e5-2a74-4f01-bde4-9e74118a3e0c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:41.972797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17625b9b-33f4-4786-9208-35443b51e89f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:41.986134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6af96-33ed-4c30-94cb-77025c51a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:41.986920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6af96-33ed-4c30-94cb-77025c51a4bd admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:41.987203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6af96-33ed-4c30-94cb-77025c51a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:41.987661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6af96-33ed-4c30-94cb-77025c51a4bd admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:41.988240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6af96-33ed-4c30-94cb-77025c51a4bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:41.995566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9028d-86bf-4dd2-9fa4-319c1946a6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:41.996721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6af96-33ed-4c30-94cb-77025c51a4bd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:41.998039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9028d-86bf-4dd2-9fa4-319c1946a6af service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:42.002254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9028d-86bf-4dd2-9fa4-319c1946a6af service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:42.003304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9028d-86bf-4dd2-9fa4-319c1946a6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:42.059946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 928/1860] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:41 2022] POST /identity/v3/users => generated 299 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:57:42.067772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6af96-33ed-4c30-94cb-77025c51a4bd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:42.094353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6af96-33ed-4c30-94cb-77025c51a4bd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:42.116082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7e9b2-45af-48d0-9e0d-aec45f81be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:42.116797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7e9b2-45af-48d0-9e0d-aec45f81be04 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:42.117105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7e9b2-45af-48d0-9e0d-aec45f81be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:42.117372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7e9b2-45af-48d0-9e0d-aec45f81be04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:42.118187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7e9b2-45af-48d0-9e0d-aec45f81be04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:42.119869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7e9b2-45af-48d0-9e0d-aec45f81be04 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:42.125382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:42.147375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 929/1861] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:42.151769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7e9b2-45af-48d0-9e0d-aec45f81be04 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:42.181403 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7e9b2-45af-48d0-9e0d-aec45f81be04 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:42.192593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01372a-3f7a-407a-b997-25ea61e9bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:42.193537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01372a-3f7a-407a-b997-25ea61e9bdf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:42.193820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01372a-3f7a-407a-b997-25ea61e9bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:42.194122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01372a-3f7a-407a-b997-25ea61e9bdf4 admin admin] PATH_INFO: `/v3/projects/ed390376ff024fd0b4be6db027cc9fde/users/e91d1ded022241ea97fbd6868a7de253/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:42.230759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01372a-3f7a-407a-b997-25ea61e9bdf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed390376ff024fd0b4be6db027cc9fde, user_id=e91d1ded022241ea97fbd6868a7de253, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:42.233537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01372a-3f7a-407a-b997-25ea61e9bdf4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:42.261819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9028d-86bf-4dd2-9fa4-319c1946a6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:42.270864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 930/1862] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:42 2022] PUT /identity/v3/projects/ed390376ff024fd0b4be6db027cc9fde/users/e91d1ded022241ea97fbd6868a7de253/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:57:42.272135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01372a-3f7a-407a-b997-25ea61e9bdf4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:42.281206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9028d-86bf-4dd2-9fa4-319c1946a6af service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:42.323842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 933/1863] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:42.520620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01372a-3f7a-407a-b997-25ea61e9bdf4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:42.538784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11dfa7-7301-4c20-bd62-1c897d72bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:42.539621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11dfa7-7301-4c20-bd62-1c897d72bc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:42.539921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11dfa7-7301-4c20-bd62-1c897d72bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:42.540281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11dfa7-7301-4c20-bd62-1c897d72bc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:42.541074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11dfa7-7301-4c20-bd62-1c897d72bc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:42.550867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11dfa7-7301-4c20-bd62-1c897d72bc89 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:42.595544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9028d-86bf-4dd2-9fa4-319c1946a6af service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:42.613291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 931/1864] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:42.615140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9028d-86bf-4dd2-9fa4-319c1946a6af service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:42.634367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841834-3c8c-49e6-9148-fe9d23f7beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:42.637760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841834-3c8c-49e6-9148-fe9d23f7beeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:42.638062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841834-3c8c-49e6-9148-fe9d23f7beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:42.638758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841834-3c8c-49e6-9148-fe9d23f7beeb admin admin] PATH_INFO: `/v3/projects/ed390376ff024fd0b4be6db027cc9fde/users/e91d1ded022241ea97fbd6868a7de253/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:42.644932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5841834-3c8c-49e6-9148-fe9d23f7beeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed390376ff024fd0b4be6db027cc9fde, user_id=e91d1ded022241ea97fbd6868a7de253, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:42.661040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5841834-3c8c-49e6-9148-fe9d23f7beeb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:42.727642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5971a0-5694-40b4-9769-14a397cb2cc3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:42.728013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5971a0-5694-40b4-9769-14a397cb2cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:42.728304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5971a0-5694-40b4-9769-14a397cb2cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:42.739315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 934/1865] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:42 2022] PUT /identity/v3/projects/ed390376ff024fd0b4be6db027cc9fde/users/e91d1ded022241ea97fbd6868a7de253/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:42.875495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0c5971a0-5694-40b4-9769-14a397cb2cc3 None None] MFA Rules not processed for user `e91d1ded022241ea97fbd6868a7de253`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:42.877013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0c5971a0-5694-40b4-9769-14a397cb2cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:43.040206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:43.196339 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 932/1866] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:43.213747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841834-3c8c-49e6-9148-fe9d23f7beeb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:43.215948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f5841834-3c8c-49e6-9148-fe9d23f7beeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:43.386899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa054b-5950-497d-afca-e0306a8af3ec None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:43.387218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa054b-5950-497d-afca-e0306a8af3ec None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:43.387618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa054b-5950-497d-afca-e0306a8af3ec None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:43.402888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 933/1867] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 12:57:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:57:43.411806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841834-3c8c-49e6-9148-fe9d23f7beeb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:43.419304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059149-3d91-4f94-9edc-5a4648ff63cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:43.422980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7baa31-919a-4b9b-9be9-08aae9530b7c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:43.423280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7baa31-919a-4b9b-9be9-08aae9530b7c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:43.423922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7baa31-919a-4b9b-9be9-08aae9530b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:43.424464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059149-3d91-4f94-9edc-5a4648ff63cd service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:43.424814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059149-3d91-4f94-9edc-5a4648ff63cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:43.425292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059149-3d91-4f94-9edc-5a4648ff63cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:43.489390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40059149-3d91-4f94-9edc-5a4648ff63cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:43.496316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40059149-3d91-4f94-9edc-5a4648ff63cd service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:43.515456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-de7baa31-919a-4b9b-9be9-08aae9530b7c None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:43.516650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-de7baa31-919a-4b9b-9be9-08aae9530b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:43.552446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 935/1868] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:43.770148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 934/1869] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 12:57:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 17 12:57:44.217102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059149-3d91-4f94-9edc-5a4648ff63cd service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:44.218758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-40059149-3d91-4f94-9edc-5a4648ff63cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:44.277861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059149-3d91-4f94-9edc-5a4648ff63cd service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:44.323128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e2417-d94b-4a8f-8591-afa843a37b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:44.324176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2417-d94b-4a8f-8591-afa843a37b69 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:44.327717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2417-d94b-4a8f-8591-afa843a37b69 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:44.328111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2417-d94b-4a8f-8591-afa843a37b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:44.369169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e2417-d94b-4a8f-8591-afa843a37b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:44.371237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e2417-d94b-4a8f-8591-afa843a37b69 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:44.420820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 936/1870] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:44.556598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7baa31-919a-4b9b-9be9-08aae9530b7c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:44.582586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7baa31-919a-4b9b-9be9-08aae9530b7c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:44.596235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493be0e-945f-49af-a569-e2005ca2d4af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:44.598904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493be0e-945f-49af-a569-e2005ca2d4af service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:44.600086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493be0e-945f-49af-a569-e2005ca2d4af service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:44.600999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493be0e-945f-49af-a569-e2005ca2d4af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:44.608022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2493be0e-945f-49af-a569-e2005ca2d4af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:44.842612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493be0e-945f-49af-a569-e2005ca2d4af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:44.844190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493be0e-945f-49af-a569-e2005ca2d4af service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:44.875025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 935/1871] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:45.940059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e2417-d94b-4a8f-8591-afa843a37b69 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:46.172824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e2417-d94b-4a8f-8591-afa843a37b69 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:46.186598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:46.189701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:46.192174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:46.192553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] PATH_INFO: `/v3/users/b53561a9950f44d3b3de373421feac11` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:46.194975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53561a9950f44d3b3de373421feac11)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:46.200929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:46.342189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:46.355262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53561a9950f44d3b3de373421feac11'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:46.358696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53561a9950f44d3b3de373421feac11'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:46.360995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53561a9950f44d3b3de373421feac11'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:46.396066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53561a9950f44d3b3de373421feac11'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:46.432824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53561a9950f44d3b3de373421feac11'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:46.490317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 937/1872] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:45 2022] DELETE /identity/v3/users/b53561a9950f44d3b3de373421feac11 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:46.493923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbc261-010c-4345-88c7-ebc55f0b5e48 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:46.494977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbc261-010c-4345-88c7-ebc55f0b5e48 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:46.495516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbc261-010c-4345-88c7-ebc55f0b5e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:46.572203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a2fbc261-010c-4345-88c7-ebc55f0b5e48 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:46.574052 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a2fbc261-010c-4345-88c7-ebc55f0b5e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:46.724533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:46.751549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 936/1873] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:46.836313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:46.838986 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:46.951486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf228d4-4f24-40d0-808f-4dd2642208f1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:46.957918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96a6ff-80bc-4637-ba2b-9be01fc4c45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:46.958928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96a6ff-80bc-4637-ba2b-9be01fc4c45a service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:46.959322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96a6ff-80bc-4637-ba2b-9be01fc4c45a service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:46.959711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96a6ff-80bc-4637-ba2b-9be01fc4c45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:46.977645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96a6ff-80bc-4637-ba2b-9be01fc4c45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:46.979411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96a6ff-80bc-4637-ba2b-9be01fc4c45a service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:46.994329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 938/1874] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:57:47.198495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbc261-010c-4345-88c7-ebc55f0b5e48 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:47.200724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a2fbc261-010c-4345-88c7-ebc55f0b5e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:47.269945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbc261-010c-4345-88c7-ebc55f0b5e48 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:47.295133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:47.297252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:47.297609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:47.297899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] PATH_INFO: `/v3/projects/3356466068b64ababaee82a9b237829a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:47.312347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3356466068b64ababaee82a9b237829a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:47.318405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:47.441000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3356466068b64ababaee82a9b237829a', 'request_id': 'req-6075e742-1817-4c51-ab3a-4c493374e445'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.449986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3356466068b64ababaee82a9b237829a', 'request_id': 'req-6075e742-1817-4c51-ab3a-4c493374e445'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.461484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3356466068b64ababaee82a9b237829a', 'request_id': 'req-6075e742-1817-4c51-ab3a-4c493374e445'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.484257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] The token cache is being invalidate because project 3356466068b64ababaee82a9b237829a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:47.484748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.488847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6075e742-1817-4c51-ab3a-4c493374e445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.492495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 937/1875] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:47 2022] DELETE /identity/v3/projects/3356466068b64ababaee82a9b237829a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:47.499638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96a6ff-80bc-4637-ba2b-9be01fc4c45a service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:47.525508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96a6ff-80bc-4637-ba2b-9be01fc4c45a service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:47.619380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:47.620708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:47.621049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:47.621361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] PATH_INFO: `/v3/users/eb3f2246e08f45c0aaa1603e893ce71c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:47.622929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3f2246e08f45c0aaa1603e893ce71c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:47.626302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:47.689585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3f2246e08f45c0aaa1603e893ce71c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.690337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3f2246e08f45c0aaa1603e893ce71c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.690943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3f2246e08f45c0aaa1603e893ce71c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.699793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3f2246e08f45c0aaa1603e893ce71c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.710690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfe1e1e1-2eac-453d-9240-78f41f940304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3f2246e08f45c0aaa1603e893ce71c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:47.713997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:47.738243 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 939/1876] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:47 2022] DELETE /identity/v3/users/eb3f2246e08f45c0aaa1603e893ce71c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:47.855554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32bd05-0d32-4abb-8e86-98d1ea8f71e9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:47.856266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32bd05-0d32-4abb-8e86-98d1ea8f71e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:47.856266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32bd05-0d32-4abb-8e86-98d1ea8f71e9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:47.857739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 938/1877] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 12:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:57:47.911614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83fa9f-ca7d-4230-b57b-93044b60ff3e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:47.911888 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83fa9f-ca7d-4230-b57b-93044b60ff3e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:47.912244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83fa9f-ca7d-4230-b57b-93044b60ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:47.947486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ac83fa9f-ca7d-4230-b57b-93044b60ff3e None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:47.950769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ac83fa9f-ca7d-4230-b57b-93044b60ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:48.134531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 940/1878] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:48.137108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32bd05-0d32-4abb-8e86-98d1ea8f71e9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:48.139318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4b32bd05-0d32-4abb-8e86-98d1ea8f71e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:48.161634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83fa9f-ca7d-4230-b57b-93044b60ff3e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:48.163307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ac83fa9f-ca7d-4230-b57b-93044b60ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:48.199088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83fa9f-ca7d-4230-b57b-93044b60ff3e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:48.207227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08b6a-4d3d-4c54-ba51-d7480456097b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:48.208176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08b6a-4d3d-4c54-ba51-d7480456097b service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:48.208547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08b6a-4d3d-4c54-ba51-d7480456097b service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:48.209446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08b6a-4d3d-4c54-ba51-d7480456097b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:48.222787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e08b6a-4d3d-4c54-ba51-d7480456097b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:48.224578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e08b6a-4d3d-4c54-ba51-d7480456097b service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:48.241164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 941/1879] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:57:48.283402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32bd05-0d32-4abb-8e86-98d1ea8f71e9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:48.289557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:48.290526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:48.290844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:48.291265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] PATH_INFO: `/v3/projects/26d9429fca264a68866a1de6f21eeb25` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:48.292907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d9429fca264a68866a1de6f21eeb25)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:48.294979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:48.407932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d9429fca264a68866a1de6f21eeb25', 'request_id': 'req-8d882672-9722-4063-8f77-7bc6550c39c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.418899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d9429fca264a68866a1de6f21eeb25', 'request_id': 'req-8d882672-9722-4063-8f77-7bc6550c39c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.427597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d9429fca264a68866a1de6f21eeb25', 'request_id': 'req-8d882672-9722-4063-8f77-7bc6550c39c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.435908 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08b6a-4d3d-4c54-ba51-d7480456097b service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:48.437851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-52e08b6a-4d3d-4c54-ba51-d7480456097b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:48.449140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] The token cache is being invalidate because project 26d9429fca264a68866a1de6f21eeb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:48.450019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.451093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.456795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08b6a-4d3d-4c54-ba51-d7480456097b service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:48.459410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 939/1880] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:48 2022] DELETE /identity/v3/projects/26d9429fca264a68866a1de6f21eeb25 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:48.463537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:48.465128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:48.486349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:48.564602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:48.565819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:48.566127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:48.566470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] PATH_INFO: `/v3/projects/8f194603402f405f8b9f706c02c6f435` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:48.574402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f194603402f405f8b9f706c02c6f435)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:48.576798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:48.600863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d882672-9722-4063-8f77-7bc6550c39c8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:48.607232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:48.608287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:48.608561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:48.608837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] PATH_INFO: `/v3/users/e91d1ded022241ea97fbd6868a7de253` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:48.610230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91d1ded022241ea97fbd6868a7de253)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:48.612406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:48.641167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f194603402f405f8b9f706c02c6f435', 'request_id': 'req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.649955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f194603402f405f8b9f706c02c6f435', 'request_id': 'req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.660408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f194603402f405f8b9f706c02c6f435', 'request_id': 'req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.663377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:48.674303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] The token cache is being invalidate because project 8f194603402f405f8b9f706c02c6f435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:48.674687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.675950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-27c37abe-47cf-469d-b3b3-9e53bc6d17e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.679217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 942/1881] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:48 2022] DELETE /identity/v3/projects/8f194603402f405f8b9f706c02c6f435 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:48.683478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301155ab-1035-4cb6-aa85-2005c861a59d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:48.684077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301155ab-1035-4cb6-aa85-2005c861a59d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:48.684436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301155ab-1035-4cb6-aa85-2005c861a59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:48.691055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91d1ded022241ea97fbd6868a7de253'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.706820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91d1ded022241ea97fbd6868a7de253'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.707173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-301155ab-1035-4cb6-aa85-2005c861a59d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:48.707720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91d1ded022241ea97fbd6868a7de253'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.708552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-301155ab-1035-4cb6-aa85-2005c861a59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:48.719721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91d1ded022241ea97fbd6868a7de253'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.729460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e6ecab47-06e7-4581-9dd9-ed03cd511b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91d1ded022241ea97fbd6868a7de253'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:48.736959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 940/1882] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:57:48 2022] DELETE /identity/v3/users/e91d1ded022241ea97fbd6868a7de253 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:57:48.782304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 943/1883] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:48.792332 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77db2-5e4f-4fa5-a0e2-e8c9262f3b5e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:48.792642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77db2-5e4f-4fa5-a0e2-e8c9262f3b5e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:48.792929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77db2-5e4f-4fa5-a0e2-e8c9262f3b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:48.814984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-faf77db2-5e4f-4fa5-a0e2-e8c9262f3b5e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:48.816191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-faf77db2-5e4f-4fa5-a0e2-e8c9262f3b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:48.887661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 941/1884] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:48.892441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301155ab-1035-4cb6-aa85-2005c861a59d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:48.902770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301155ab-1035-4cb6-aa85-2005c861a59d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:48.908704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18fd1b-957c-4b64-b849-02409943c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:48.909554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18fd1b-957c-4b64-b849-02409943c68a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:48.909908 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18fd1b-957c-4b64-b849-02409943c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:48.910313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18fd1b-957c-4b64-b849-02409943c68a admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:48.911129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18fd1b-957c-4b64-b849-02409943c68a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:48.911518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18fd1b-957c-4b64-b849-02409943c68a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:48.913499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18fd1b-957c-4b64-b849-02409943c68a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:48.928236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 944/1885] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:57:48.933015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf77db2-5e4f-4fa5-a0e2-e8c9262f3b5e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:48.943012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf77db2-5e4f-4fa5-a0e2-e8c9262f3b5e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:48.948074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b92029-fa83-404d-9728-d6ed5c84ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:48.948892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b92029-fa83-404d-9728-d6ed5c84ce74 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:48.949022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b92029-fa83-404d-9728-d6ed5c84ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:48.949297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b92029-fa83-404d-9728-d6ed5c84ce74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:48.950005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b92029-fa83-404d-9728-d6ed5c84ce74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:48.952161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b92029-fa83-404d-9728-d6ed5c84ce74 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:48.981807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 942/1886] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:48 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:48.987825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18fd1b-957c-4b64-b849-02409943c68a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.000255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18fd1b-957c-4b64-b849-02409943c68a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.062729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b92029-fa83-404d-9728-d6ed5c84ce74 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.064919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62b92029-fa83-404d-9728-d6ed5c84ce74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:49.081018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:49.081887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82f008-1e61-45b5-babe-46c903a3fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.082656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82f008-1e61-45b5-babe-46c903a3fa21 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.082942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82f008-1e61-45b5-babe-46c903a3fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.083217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82f008-1e61-45b5-babe-46c903a3fa21 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.083941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82f008-1e61-45b5-babe-46c903a3fa21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.085963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82f008-1e61-45b5-babe-46c903a3fa21 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.118681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 945/1887] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:48 2022] POST /identity/v3/users => generated 305 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:49.119999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82f008-1e61-45b5-babe-46c903a3fa21 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.131780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82f008-1e61-45b5-babe-46c903a3fa21 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.136789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ced6b-e9b7-4507-81b4-408cec322f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.137612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ced6b-e9b7-4507-81b4-408cec322f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.137958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ced6b-e9b7-4507-81b4-408cec322f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.138344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ced6b-e9b7-4507-81b4-408cec322f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.139262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ced6b-e9b7-4507-81b4-408cec322f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.141182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ced6b-e9b7-4507-81b4-408cec322f46 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.149379 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b92029-fa83-404d-9728-d6ed5c84ce74 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.154481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 946/1888] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:49.157766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.157766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.157766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.157766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] PATH_INFO: `/v3/projects/ed390376ff024fd0b4be6db027cc9fde` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.158647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ced6b-e9b7-4507-81b4-408cec322f46 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.160337 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed390376ff024fd0b4be6db027cc9fde)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.162716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.170360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ced6b-e9b7-4507-81b4-408cec322f46 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.176609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637541c-a6ad-40db-b457-ee2b8340f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.177323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637541c-a6ad-40db-b457-ee2b8340f864 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.177614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637541c-a6ad-40db-b457-ee2b8340f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.177896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637541c-a6ad-40db-b457-ee2b8340f864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.178891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637541c-a6ad-40db-b457-ee2b8340f864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.180769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637541c-a6ad-40db-b457-ee2b8340f864 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.194254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 947/1889] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:57:49.198974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637541c-a6ad-40db-b457-ee2b8340f864 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.212727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637541c-a6ad-40db-b457-ee2b8340f864 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.219441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420963e3-f7a5-4284-a124-8fa322e2c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.220826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420963e3-f7a5-4284-a124-8fa322e2c458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.221144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420963e3-f7a5-4284-a124-8fa322e2c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.221466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420963e3-f7a5-4284-a124-8fa322e2c458 admin admin] PATH_INFO: `/v3/projects/b6948adee9f644cfba5bef3d01727478/users/2e7ad944dacc44e3a25d6328345bc43d/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.244410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420963e3-f7a5-4284-a124-8fa322e2c458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6948adee9f644cfba5bef3d01727478, user_id=2e7ad944dacc44e3a25d6328345bc43d, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.246542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed390376ff024fd0b4be6db027cc9fde', 'request_id': 'req-e24c1f85-b458-4161-ad27-d1a56631051a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:49.247153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420963e3-f7a5-4284-a124-8fa322e2c458 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.255021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed390376ff024fd0b4be6db027cc9fde', 'request_id': 'req-e24c1f85-b458-4161-ad27-d1a56631051a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:49.265451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed390376ff024fd0b4be6db027cc9fde', 'request_id': 'req-e24c1f85-b458-4161-ad27-d1a56631051a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:49.287551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 948/1890] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:49 2022] PUT /identity/v3/projects/b6948adee9f644cfba5bef3d01727478/users/2e7ad944dacc44e3a25d6328345bc43d/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:49.289976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3efb-fb82-44bf-a75a-ee2415858ead None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.290302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3efb-fb82-44bf-a75a-ee2415858ead None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.290583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3efb-fb82-44bf-a75a-ee2415858ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.294641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] The token cache is being invalidate because project ed390376ff024fd0b4be6db027cc9fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:57:49.294941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:49.296355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e24c1f85-b458-4161-ad27-d1a56631051a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:57:49.299296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 943/1891] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:57:49 2022] DELETE /identity/v3/projects/ed390376ff024fd0b4be6db027cc9fde => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:49.304695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eab80-f22d-4a12-afa2-e5b5983abb79 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.304957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eab80-f22d-4a12-afa2-e5b5983abb79 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.305682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eab80-f22d-4a12-afa2-e5b5983abb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.324449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2aef3efb-fb82-44bf-a75a-ee2415858ead None None] MFA Rules not processed for user `2e7ad944dacc44e3a25d6328345bc43d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:49.325690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2aef3efb-fb82-44bf-a75a-ee2415858ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:49.336948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7c0eab80-f22d-4a12-afa2-e5b5983abb79 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:49.338313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7c0eab80-f22d-4a12-afa2-e5b5983abb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:49.341583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:49.419502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 949/1892] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:49.423160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 944/1893] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:49.428749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3efb-fb82-44bf-a75a-ee2415858ead None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.430332 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2aef3efb-fb82-44bf-a75a-ee2415858ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:49.431144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513898c-89d1-40aa-923e-616ef6322f33 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.431562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513898c-89d1-40aa-923e-616ef6322f33 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.431733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513898c-89d1-40aa-923e-616ef6322f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.448986 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3efb-fb82-44bf-a75a-ee2415858ead None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.457411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5bf3-04e9-498d-81fc-50c639af6025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.458966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5bf3-04e9-498d-81fc-50c639af6025 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.459262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5bf3-04e9-498d-81fc-50c639af6025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.459541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5bf3-04e9-498d-81fc-50c639af6025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.460238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f5bf3-04e9-498d-81fc-50c639af6025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.462243 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f5bf3-04e9-498d-81fc-50c639af6025 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.479842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a513898c-89d1-40aa-923e-616ef6322f33 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:49.481602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a513898c-89d1-40aa-923e-616ef6322f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:49.491490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 945/1894] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:57:49.493369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 950/1895] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:49 2022] POST /identity/v3/projects => generated 407 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:49.496173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513898c-89d1-40aa-923e-616ef6322f33 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.497327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5bf3-04e9-498d-81fc-50c639af6025 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.508743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513898c-89d1-40aa-923e-616ef6322f33 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.563011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:49.571695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5bf3-04e9-498d-81fc-50c639af6025 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.579280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706bac7-a5aa-4e6e-8e8d-c6ace004b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.580365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706bac7-a5aa-4e6e-8e8d-c6ace004b206 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.580694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706bac7-a5aa-4e6e-8e8d-c6ace004b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.581748 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706bac7-a5aa-4e6e-8e8d-c6ace004b206 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.581748 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706bac7-a5aa-4e6e-8e8d-c6ace004b206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.584246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706bac7-a5aa-4e6e-8e8d-c6ace004b206 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.604806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4b585-574f-4856-9385-361bd9b5a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.605559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4b585-574f-4856-9385-361bd9b5a66b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.605944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4b585-574f-4856-9385-361bd9b5a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.606357 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4b585-574f-4856-9385-361bd9b5a66b admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.607178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4b585-574f-4856-9385-361bd9b5a66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:57:49.607580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4b585-574f-4856-9385-361bd9b5a66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.609711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4b585-574f-4856-9385-361bd9b5a66b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.612963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 951/1896] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:49 2022] POST /identity/v3/users => generated 310 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:49.616976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706bac7-a5aa-4e6e-8e8d-c6ace004b206 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.628910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 946/1897] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:57:49.631158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706bac7-a5aa-4e6e-8e8d-c6ace004b206 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.633508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4b585-574f-4856-9385-361bd9b5a66b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.636749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22792a86-1609-4a33-847f-2797310383b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.637458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22792a86-1609-4a33-847f-2797310383b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.637743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22792a86-1609-4a33-847f-2797310383b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.638024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22792a86-1609-4a33-847f-2797310383b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.638806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22792a86-1609-4a33-847f-2797310383b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.640913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22792a86-1609-4a33-847f-2797310383b9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.644785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4b585-574f-4856-9385-361bd9b5a66b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.649746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8655bd6-6ff5-422d-89af-48ff0697829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.650529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8655bd6-6ff5-422d-89af-48ff0697829c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.650813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8655bd6-6ff5-422d-89af-48ff0697829c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.651083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8655bd6-6ff5-422d-89af-48ff0697829c admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.651812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8655bd6-6ff5-422d-89af-48ff0697829c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.653882 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8655bd6-6ff5-422d-89af-48ff0697829c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.654271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 952/1898] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:49.657323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22792a86-1609-4a33-847f-2797310383b9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.667949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22792a86-1609-4a33-847f-2797310383b9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.673256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6f20e-99f6-4994-b339-bba9efa9868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.674232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6f20e-99f6-4994-b339-bba9efa9868e admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.674521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6f20e-99f6-4994-b339-bba9efa9868e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.674788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6f20e-99f6-4994-b339-bba9efa9868e admin admin] PATH_INFO: `/v3/projects/3b83ab044a9b4628a2d20a3da81a10b0/users/f5b40501820b4b5d845edbcbb2fedbef/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.700189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 947/1899] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:57:49 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:57:49.704075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8655bd6-6ff5-422d-89af-48ff0697829c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.706442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6f20e-99f6-4994-b339-bba9efa9868e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b83ab044a9b4628a2d20a3da81a10b0, user_id=f5b40501820b4b5d845edbcbb2fedbef, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.709788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6f20e-99f6-4994-b339-bba9efa9868e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.736503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 953/1900] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:49 2022] PUT /identity/v3/projects/3b83ab044a9b4628a2d20a3da81a10b0/users/f5b40501820b4b5d845edbcbb2fedbef/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:49.741471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6f20e-99f6-4994-b339-bba9efa9868e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.792082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8655bd6-6ff5-422d-89af-48ff0697829c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.817307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:49.849837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6f20e-99f6-4994-b339-bba9efa9868e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.854187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e27a0-9110-4921-aef6-7ebd22568082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.855058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e27a0-9110-4921-aef6-7ebd22568082 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.855795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e27a0-9110-4921-aef6-7ebd22568082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.855795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e27a0-9110-4921-aef6-7ebd22568082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.856497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e27a0-9110-4921-aef6-7ebd22568082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.859344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e27a0-9110-4921-aef6-7ebd22568082 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.872655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 954/1901] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:49.878221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e27a0-9110-4921-aef6-7ebd22568082 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.883383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c9c99-1411-4fa7-8999-79d127948940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.884104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c9c99-1411-4fa7-8999-79d127948940 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.884384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c9c99-1411-4fa7-8999-79d127948940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.884667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c9c99-1411-4fa7-8999-79d127948940 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.885377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c9c99-1411-4fa7-8999-79d127948940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.887405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c9c99-1411-4fa7-8999-79d127948940 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.888613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e27a0-9110-4921-aef6-7ebd22568082 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.896967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9fb0a-805e-4300-89df-a4ad22a658f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.897895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9fb0a-805e-4300-89df-a4ad22a658f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.898555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9fb0a-805e-4300-89df-a4ad22a658f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.898555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9fb0a-805e-4300-89df-a4ad22a658f3 admin admin] PATH_INFO: `/v3/projects/3b83ab044a9b4628a2d20a3da81a10b0/users/f5b40501820b4b5d845edbcbb2fedbef/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.900891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9fb0a-805e-4300-89df-a4ad22a658f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b83ab044a9b4628a2d20a3da81a10b0, user_id=f5b40501820b4b5d845edbcbb2fedbef, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:49.904089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9fb0a-805e-4300-89df-a4ad22a658f3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:49.913317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 948/1902] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:57:49 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:57:49.917640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c9c99-1411-4fa7-8999-79d127948940 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:49.918509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 955/1903] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:49 2022] PUT /identity/v3/projects/3b83ab044a9b4628a2d20a3da81a10b0/users/f5b40501820b4b5d845edbcbb2fedbef/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:57:49.928234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c9c99-1411-4fa7-8999-79d127948940 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:49.929608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2f5b-8f75-4281-865b-f2eeacc8afca None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.930025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2f5b-8f75-4281-865b-f2eeacc8afca None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.930508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2f5b-8f75-4281-865b-f2eeacc8afca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.965459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8aaa2f5b-8f75-4281-865b-f2eeacc8afca None None] MFA Rules not processed for user `f5b40501820b4b5d845edbcbb2fedbef`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:49.966754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8aaa2f5b-8f75-4281-865b-f2eeacc8afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:49.977116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:49.996316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384f0bf-fee0-4a55-9ad8-0478c819c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:49.997378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384f0bf-fee0-4a55-9ad8-0478c819c962 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:49.997660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384f0bf-fee0-4a55-9ad8-0478c819c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:49.997938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384f0bf-fee0-4a55-9ad8-0478c819c962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:49.998718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384f0bf-fee0-4a55-9ad8-0478c819c962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:50.000701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384f0bf-fee0-4a55-9ad8-0478c819c962 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:50.011638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 949/1904] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:50.017104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384f0bf-fee0-4a55-9ad8-0478c819c962 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:50.033880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384f0bf-fee0-4a55-9ad8-0478c819c962 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:50.039478 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3fed-83c8-48c8-bf62-9209c3e336b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:50.040164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3fed-83c8-48c8-bf62-9209c3e336b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:50.040448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3fed-83c8-48c8-bf62-9209c3e336b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:50.040731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3fed-83c8-48c8-bf62-9209c3e336b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:50.041473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a3fed-83c8-48c8-bf62-9209c3e336b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:50.043219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a3fed-83c8-48c8-bf62-9209c3e336b0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:50.057413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 956/1905] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:50.057614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 950/1906] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:57:50.059448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2f5b-8f75-4281-865b-f2eeacc8afca None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:50.066361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3fed-83c8-48c8-bf62-9209c3e336b0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:50.068199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ef8a3fed-83c8-48c8-bf62-9209c3e336b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:50.070729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2f5b-8f75-4281-865b-f2eeacc8afca None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:50.075703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c1d4d-08c9-42c7-978e-ea7162aa70b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:50.076935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c1d4d-08c9-42c7-978e-ea7162aa70b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:50.077857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c1d4d-08c9-42c7-978e-ea7162aa70b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:50.078186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c1d4d-08c9-42c7-978e-ea7162aa70b5 admin admin] PATH_INFO: `/v3/projects/81f8387fed3243638f6724e934e5746e/users/8b86a938acb244b8a58b72856e7f02a0/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:50.097097 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c1d4d-08c9-42c7-978e-ea7162aa70b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f8387fed3243638f6724e934e5746e, user_id=8b86a938acb244b8a58b72856e7f02a0, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:50.097896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c1d4d-08c9-42c7-978e-ea7162aa70b5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:50.118635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 957/1907] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:57:50 2022] PUT /identity/v3/projects/81f8387fed3243638f6724e934e5746e/users/8b86a938acb244b8a58b72856e7f02a0/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:57:50.130411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd4e40-01af-406c-b972-b2f40a9e276d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:50.130648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd4e40-01af-406c-b972-b2f40a9e276d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:50.130827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd4e40-01af-406c-b972-b2f40a9e276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:50.133942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3fed-83c8-48c8-bf62-9209c3e336b0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:50.160329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-85bd4e40-01af-406c-b972-b2f40a9e276d None None] MFA Rules not processed for user `8b86a938acb244b8a58b72856e7f02a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:57:50.161730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-85bd4e40-01af-406c-b972-b2f40a9e276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:50.194377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e6fd4-6e7c-4761-a749-d705199fb0e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:50.196753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e6fd4-6e7c-4761-a749-d705199fb0e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:50.197653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e6fd4-6e7c-4761-a749-d705199fb0e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:50.197653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e6fd4-6e7c-4761-a749-d705199fb0e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:50.238445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 958/1908] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:57:50.250478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd4e40-01af-406c-b972-b2f40a9e276d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:50.251833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-85bd4e40-01af-406c-b972-b2f40a9e276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:57:50.264315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd4e40-01af-406c-b972-b2f40a9e276d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:50.264534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e6fd4-6e7c-4761-a749-d705199fb0e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:50.266117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e6fd4-6e7c-4761-a749-d705199fb0e1 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:50.269147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d10bc-6679-4c77-b34e-58d1e1c03b10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:50.269822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d10bc-6679-4c77-b34e-58d1e1c03b10 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:50.270118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d10bc-6679-4c77-b34e-58d1e1c03b10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:50.270426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d10bc-6679-4c77-b34e-58d1e1c03b10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:50.277208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 951/1909] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:50 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:57:50.281312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d10bc-6679-4c77-b34e-58d1e1c03b10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:50.282852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d10bc-6679-4c77-b34e-58d1e1c03b10 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:50.296851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 959/1910] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:57:50.586808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e6fd4-6e7c-4761-a749-d705199fb0e1 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:57:50.599317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e6fd4-6e7c-4761-a749-d705199fb0e1 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:57:50.604201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3818ccd-f192-4b77-b149-28798e668c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:57:50.605099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3818ccd-f192-4b77-b149-28798e668c02 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:57:50.605460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3818ccd-f192-4b77-b149-28798e668c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:57:50.607403 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3818ccd-f192-4b77-b149-28798e668c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:57:50.673047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:57:50.725480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3818ccd-f192-4b77-b149-28798e668c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:57:50.727104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3818ccd-f192-4b77-b149-28798e668c02 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:57:50.739606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 952/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:57:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:58:00.297603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:00.733409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=12 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:07.159853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d10bc-6679-4c77-b34e-58d1e1c03b10 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:07.161452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-567d10bc-6679-4c77-b34e-58d1e1c03b10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:07.238333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d10bc-6679-4c77-b34e-58d1e1c03b10 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:07.243732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:07.244767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:07.245433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:07.245433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] PATH_INFO: `/v3/users/72e85bdaf3444f0ca3d5a84def5ccf88` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:07.246642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e85bdaf3444f0ca3d5a84def5ccf88)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:07.248776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:07.301968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e85bdaf3444f0ca3d5a84def5ccf88'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:07.302743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e85bdaf3444f0ca3d5a84def5ccf88'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:07.303537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e85bdaf3444f0ca3d5a84def5ccf88'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:07.311366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e85bdaf3444f0ca3d5a84def5ccf88'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:07.321558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e85bdaf3444f0ca3d5a84def5ccf88'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:07.343183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 960/1912] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:07 2022] DELETE /identity/v3/users/72e85bdaf3444f0ca3d5a84def5ccf88 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:07.349783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60135811-4578-4970-a8d8-a659810d29f3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:07.350350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60135811-4578-4970-a8d8-a659810d29f3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:07.350705 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60135811-4578-4970-a8d8-a659810d29f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:07.378273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-60135811-4578-4970-a8d8-a659810d29f3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:07.379744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-60135811-4578-4970-a8d8-a659810d29f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:07.481460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 953/1913] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:07.494009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:07.500151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:07.650707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f5eb-b678-4d94-a031-0cafc1303b71 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:07.655128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e6e22-9e48-41e4-b21f-2dbbf0059d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:07.656586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e6e22-9e48-41e4-b21f-2dbbf0059d50 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:07.657539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e6e22-9e48-41e4-b21f-2dbbf0059d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:07.658137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e6e22-9e48-41e4-b21f-2dbbf0059d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:07.677831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e6e22-9e48-41e4-b21f-2dbbf0059d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:07.679514 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e6e22-9e48-41e4-b21f-2dbbf0059d50 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:07.691084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 961/1914] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:08.069976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60135811-4578-4970-a8d8-a659810d29f3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:08.071897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-60135811-4578-4970-a8d8-a659810d29f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:08.130786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60135811-4578-4970-a8d8-a659810d29f3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:08.146872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e6e22-9e48-41e4-b21f-2dbbf0059d50 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:08.148416 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d13e6e22-9e48-41e4-b21f-2dbbf0059d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:08.152894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:08.153908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:08.154286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:08.154626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] PATH_INFO: `/v3/projects/2bf250ae8eb641f9bc47184c21dc1f6c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:08.155909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf250ae8eb641f9bc47184c21dc1f6c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:08.159344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:08.165470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e6e22-9e48-41e4-b21f-2dbbf0059d50 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:08.176657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:08.177860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:08.178169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:08.178656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] PATH_INFO: `/v3/users/2e7ad944dacc44e3a25d6328345bc43d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:08.180441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7ad944dacc44e3a25d6328345bc43d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:08.182635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:08.201220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:08.223742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf250ae8eb641f9bc47184c21dc1f6c', 'request_id': 'req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.232321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf250ae8eb641f9bc47184c21dc1f6c', 'request_id': 'req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.239435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf250ae8eb641f9bc47184c21dc1f6c', 'request_id': 'req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.255941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] The token cache is being invalidate because project 2bf250ae8eb641f9bc47184c21dc1f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:08.256232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7ad944dacc44e3a25d6328345bc43d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.256446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.257168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.257766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7ad944dacc44e3a25d6328345bc43d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.258614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7ad944dacc44e3a25d6328345bc43d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.259202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 954/1915] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:08 2022] DELETE /identity/v3/projects/2bf250ae8eb641f9bc47184c21dc1f6c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:08.263263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:08.265410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:08.270941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7ad944dacc44e3a25d6328345bc43d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.283259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7ad944dacc44e3a25d6328345bc43d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.318049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 962/1916] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:08 2022] DELETE /identity/v3/users/2e7ad944dacc44e3a25d6328345bc43d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:08.318049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:08.318709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:08.360570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517c7f3-4e9b-4dd2-aa66-b7aeaab02e72 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:08.385680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3f8e2-6262-4141-98f4-5b2c00328cde admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:08.390775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0d389-de87-41c4-9982-7f8fec41f515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:08.392102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d389-de87-41c4-9982-7f8fec41f515 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:08.392102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d389-de87-41c4-9982-7f8fec41f515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:08.392749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d389-de87-41c4-9982-7f8fec41f515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:08.394835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-05d0d389-de87-41c4-9982-7f8fec41f515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:08.396343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:08.430215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:08.431299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:08.431585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:08.431869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] PATH_INFO: `/v3/users/a9ce8c1cc579417aa7bdad5ef2037d88` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:08.433200 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ce8c1cc579417aa7bdad5ef2037d88)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:08.435235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:08.458503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0d389-de87-41c4-9982-7f8fec41f515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:08.460031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0d389-de87-41c4-9982-7f8fec41f515 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:08.470425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 963/1917] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:08.471768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5502a4-5792-4e7e-ac6f-2b3635e1ebf2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:08.472121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5502a4-5792-4e7e-ac6f-2b3635e1ebf2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:08.472336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5502a4-5792-4e7e-ac6f-2b3635e1ebf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:08.490115 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ce8c1cc579417aa7bdad5ef2037d88'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.490319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7d5502a4-5792-4e7e-ac6f-2b3635e1ebf2 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:08.491621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7d5502a4-5792-4e7e-ac6f-2b3635e1ebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:08.500167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 964/1918] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:08.507439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ce8c1cc579417aa7bdad5ef2037d88'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.508410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ce8c1cc579417aa7bdad5ef2037d88'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.510422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5502a4-5792-4e7e-ac6f-2b3635e1ebf2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:08.511816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7d5502a4-5792-4e7e-ac6f-2b3635e1ebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:08.521155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ce8c1cc579417aa7bdad5ef2037d88'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.531129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ce8c1cc579417aa7bdad5ef2037d88'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:08.540904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 955/1919] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:08 2022] DELETE /identity/v3/users/a9ce8c1cc579417aa7bdad5ef2037d88 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:08.565628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:08.581164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5502a4-5792-4e7e-ac6f-2b3635e1ebf2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:08.653552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122a9a7-4f71-47ea-9a5e-9f85649c1ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:08.656032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122a9a7-4f71-47ea-9a5e-9f85649c1ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:08.656032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122a9a7-4f71-47ea-9a5e-9f85649c1ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:08.656032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122a9a7-4f71-47ea-9a5e-9f85649c1ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:08.658443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5122a9a7-4f71-47ea-9a5e-9f85649c1ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:08.793474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122a9a7-4f71-47ea-9a5e-9f85649c1ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:08.796557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122a9a7-4f71-47ea-9a5e-9f85649c1ef8 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:08.816105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 965/1920] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:58:08.965730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:08.968026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:08.997867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37074352-d8be-4a5e-ade8-73fed4b18674 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:09.022135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:09.023911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:09.024626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:09.025413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] PATH_INFO: `/v3/projects/b6141d126bd444c09338d935d782650f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:09.028731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6141d126bd444c09338d935d782650f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:09.043646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:09.227682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6141d126bd444c09338d935d782650f', 'request_id': 'req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:09.241304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6141d126bd444c09338d935d782650f', 'request_id': 'req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:09.256610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6141d126bd444c09338d935d782650f', 'request_id': 'req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:09.289658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] The token cache is being invalidate because project b6141d126bd444c09338d935d782650f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:09.290627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:09.295122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b807a9f9-d53b-44c1-ae47-48ea64eea6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:09.301939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 956/1921] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:08 2022] DELETE /identity/v3/projects/b6141d126bd444c09338d935d782650f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:09.309107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284abee8-df91-46c8-944b-56b0ad5b8eea None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:09.310038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284abee8-df91-46c8-944b-56b0ad5b8eea None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:09.310402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284abee8-df91-46c8-944b-56b0ad5b8eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:09.340883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-284abee8-df91-46c8-944b-56b0ad5b8eea None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:09.342396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-284abee8-df91-46c8-944b-56b0ad5b8eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:09.427662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 966/1922] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:09.437980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37260c-3e56-4087-b3ee-15df9eb695e1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:09.438585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37260c-3e56-4087-b3ee-15df9eb695e1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:09.438841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37260c-3e56-4087-b3ee-15df9eb695e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:09.475900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ed37260c-3e56-4087-b3ee-15df9eb695e1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:09.479000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ed37260c-3e56-4087-b3ee-15df9eb695e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:09.504983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 957/1923] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:09.507828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284abee8-df91-46c8-944b-56b0ad5b8eea None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:09.534800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284abee8-df91-46c8-944b-56b0ad5b8eea None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:09.550473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91268d7a-01b6-4c9f-ab6b-e7e003f5583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:09.551216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268d7a-01b6-4c9f-ab6b-e7e003f5583d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:09.551505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268d7a-01b6-4c9f-ab6b-e7e003f5583d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:09.555323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268d7a-01b6-4c9f-ab6b-e7e003f5583d admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:09.558017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91268d7a-01b6-4c9f-ab6b-e7e003f5583d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:09.558374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91268d7a-01b6-4c9f-ab6b-e7e003f5583d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:09.563669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91268d7a-01b6-4c9f-ab6b-e7e003f5583d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:09.599291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 967/1924] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:58:09.601195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37260c-3e56-4087-b3ee-15df9eb695e1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:09.614709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37260c-3e56-4087-b3ee-15df9eb695e1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:09.629655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8537e6-08f4-4c93-9c82-2e8bdc9a3b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:09.631129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8537e6-08f4-4c93-9c82-2e8bdc9a3b06 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:09.633643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8537e6-08f4-4c93-9c82-2e8bdc9a3b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:09.638923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8537e6-08f4-4c93-9c82-2e8bdc9a3b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:09.639965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8537e6-08f4-4c93-9c82-2e8bdc9a3b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:09.648106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8537e6-08f4-4c93-9c82-2e8bdc9a3b06 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:09.694776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 958/1925] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:09 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:09.696101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91268d7a-01b6-4c9f-ab6b-e7e003f5583d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:09.719581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91268d7a-01b6-4c9f-ab6b-e7e003f5583d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:09.823694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:09.854349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6fd86-eb33-49be-affa-43624116a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:09.854729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6fd86-eb33-49be-affa-43624116a3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:09.854997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6fd86-eb33-49be-affa-43624116a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:09.855279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6fd86-eb33-49be-affa-43624116a3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:09.855994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6fd86-eb33-49be-affa-43624116a3c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:09.858274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6fd86-eb33-49be-affa-43624116a3c7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:09.890677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 968/1926] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:09 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:09.893081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8537e6-08f4-4c93-9c82-2e8bdc9a3b06 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:09.905039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:09.909229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8537e6-08f4-4c93-9c82-2e8bdc9a3b06 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:09.916090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe2fd8-b6c0-48df-b427-d4f3ed36e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:09.917224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe2fd8-b6c0-48df-b427-d4f3ed36e0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:09.917702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe2fd8-b6c0-48df-b427-d4f3ed36e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:09.918420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe2fd8-b6c0-48df-b427-d4f3ed36e0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:09.919657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe2fd8-b6c0-48df-b427-d4f3ed36e0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:09.921737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe2fd8-b6c0-48df-b427-d4f3ed36e0a8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:09.935856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 959/1927] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:09.940078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6fd86-eb33-49be-affa-43624116a3c7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:09.955496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6fd86-eb33-49be-affa-43624116a3c7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:09.961037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b5ed3-89cc-4c09-98fd-84e897484398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:09.961758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b5ed3-89cc-4c09-98fd-84e897484398 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:09.962045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b5ed3-89cc-4c09-98fd-84e897484398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:09.962377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b5ed3-89cc-4c09-98fd-84e897484398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:09.963140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b5ed3-89cc-4c09-98fd-84e897484398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:09.964943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b5ed3-89cc-4c09-98fd-84e897484398 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:09.978037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 969/1928] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:09.982635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe2fd8-b6c0-48df-b427-d4f3ed36e0a8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:09.996750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe2fd8-b6c0-48df-b427-d4f3ed36e0a8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:10.004616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d8f5-9a87-4c05-9f1d-e8ff89e5130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:10.005159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d8f5-9a87-4c05-9f1d-e8ff89e5130f admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.005447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d8f5-9a87-4c05-9f1d-e8ff89e5130f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.005788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d8f5-9a87-4c05-9f1d-e8ff89e5130f admin admin] PATH_INFO: `/v3/projects/4996ec5c3d74469a89f5dcbd269f5e25/users/d8c58a1aa585494e8653932a29fcbcc7/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.039188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d8f5-9a87-4c05-9f1d-e8ff89e5130f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4996ec5c3d74469a89f5dcbd269f5e25, user_id=d8c58a1aa585494e8653932a29fcbcc7, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:10.044284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d8f5-9a87-4c05-9f1d-e8ff89e5130f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:10.069591 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b5ed3-89cc-4c09-98fd-84e897484398 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:10.071574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-423b5ed3-89cc-4c09-98fd-84e897484398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:10.077518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 960/1929] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:09 2022] PUT /identity/v3/projects/4996ec5c3d74469a89f5dcbd269f5e25/users/d8c58a1aa585494e8653932a29fcbcc7/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:10.100093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e658098-9e8d-4ddd-8e73-16ea18896537 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.100880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e658098-9e8d-4ddd-8e73-16ea18896537 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.101199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e658098-9e8d-4ddd-8e73-16ea18896537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.104935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b5ed3-89cc-4c09-98fd-84e897484398 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:10.147189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7e658098-9e8d-4ddd-8e73-16ea18896537 None None] MFA Rules not processed for user `d8c58a1aa585494e8653932a29fcbcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:10.148509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e658098-9e8d-4ddd-8e73-16ea18896537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:10.223518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:10.224671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.225035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.225378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] PATH_INFO: `/v3/projects/b6948adee9f644cfba5bef3d01727478` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.226986 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6948adee9f644cfba5bef3d01727478)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:10.229560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:10.237038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 961/1930] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:10.238315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e658098-9e8d-4ddd-8e73-16ea18896537 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:10.240148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e658098-9e8d-4ddd-8e73-16ea18896537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:10.258144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e658098-9e8d-4ddd-8e73-16ea18896537 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:10.265321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:10.267459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.267988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.268425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] PATH_INFO: `/v3/users/8b86a938acb244b8a58b72856e7f02a0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.270764 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b86a938acb244b8a58b72856e7f02a0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:10.274155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:10.300682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6948adee9f644cfba5bef3d01727478', 'request_id': 'req-3c561837-99ea-4a89-a0ee-e944c7519a34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.323525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6948adee9f644cfba5bef3d01727478', 'request_id': 'req-3c561837-99ea-4a89-a0ee-e944c7519a34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.336469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6948adee9f644cfba5bef3d01727478', 'request_id': 'req-3c561837-99ea-4a89-a0ee-e944c7519a34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.350194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b86a938acb244b8a58b72856e7f02a0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.354698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] The token cache is being invalidate because project b6948adee9f644cfba5bef3d01727478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:10.354698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.355684 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.358314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 970/1931] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:10 2022] DELETE /identity/v3/projects/b6948adee9f644cfba5bef3d01727478 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:10.359063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:10.360612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:10.384381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b86a938acb244b8a58b72856e7f02a0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.392473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b86a938acb244b8a58b72856e7f02a0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.410244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b86a938acb244b8a58b72856e7f02a0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.420417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b86a938acb244b8a58b72856e7f02a0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.430160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 962/1932] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:10 2022] DELETE /identity/v3/users/8b86a938acb244b8a58b72856e7f02a0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:10.430372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:10.432558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:10.435954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:10.463200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c561837-99ea-4a89-a0ee-e944c7519a34 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:10.476020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:10.525029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770259c-13ec-4d6c-9e49-ac57bdf2d4ec admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:10.531705 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:10.532694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.533636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.533921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] PATH_INFO: `/v3/users/f5b40501820b4b5d845edbcbb2fedbef` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.535368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b40501820b4b5d845edbcbb2fedbef)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:10.538181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:10.558676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523db17-e96d-4847-bf06-5bd38c19e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:10.559378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523db17-e96d-4847-bf06-5bd38c19e8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.559664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523db17-e96d-4847-bf06-5bd38c19e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.559942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523db17-e96d-4847-bf06-5bd38c19e8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.560651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523db17-e96d-4847-bf06-5bd38c19e8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:10.562703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523db17-e96d-4847-bf06-5bd38c19e8cd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:10.601555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 971/1933] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:10 2022] POST /identity/v3/projects => generated 365 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:10.603159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f228-9b49-4cdb-be04-f2032c9e3c0d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.603501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f228-9b49-4cdb-be04-f2032c9e3c0d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.603869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f228-9b49-4cdb-be04-f2032c9e3c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.623879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6216f228-9b49-4cdb-be04-f2032c9e3c0d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:10.625104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b40501820b4b5d845edbcbb2fedbef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.625465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6216f228-9b49-4cdb-be04-f2032c9e3c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:10.640060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b40501820b4b5d845edbcbb2fedbef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.641209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b40501820b4b5d845edbcbb2fedbef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.657583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b40501820b4b5d845edbcbb2fedbef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.676400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b40501820b4b5d845edbcbb2fedbef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:10.689462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 963/1934] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:10 2022] DELETE /identity/v3/users/f5b40501820b4b5d845edbcbb2fedbef => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:10.690454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:10.691974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:10.733934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 972/1935] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:10.765987 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f228-9b49-4cdb-be04-f2032c9e3c0d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:10.769502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6216f228-9b49-4cdb-be04-f2032c9e3c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:10.777352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a4033-9eec-4300-86d5-edfb57139a3f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:10.783982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c0d3-e519-4afd-b8a7-3c6b2f17de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:10.785066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c0d3-e519-4afd-b8a7-3c6b2f17de4e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.786346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c0d3-e519-4afd-b8a7-3c6b2f17de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.786671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c0d3-e519-4afd-b8a7-3c6b2f17de4e admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.787716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61c0d3-e519-4afd-b8a7-3c6b2f17de4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:10.790718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61c0d3-e519-4afd-b8a7-3c6b2f17de4e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:10.842193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 964/1936] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:10 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:10.847717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c0d3-e519-4afd-b8a7-3c6b2f17de4e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:10.867881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c0d3-e519-4afd-b8a7-3c6b2f17de4e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:10.883204 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d64128-df41-4877-967d-393b17741fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:10.884495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d64128-df41-4877-967d-393b17741fba admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.884886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d64128-df41-4877-967d-393b17741fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.885272 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d64128-df41-4877-967d-393b17741fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.886371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d64128-df41-4877-967d-393b17741fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:10.889351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d64128-df41-4877-967d-393b17741fba admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:10.892303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f228-9b49-4cdb-be04-f2032c9e3c0d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:10.906857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 965/1937] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:58:10.910064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d64128-df41-4877-967d-393b17741fba admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:10.932672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d64128-df41-4877-967d-393b17741fba admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:10.955329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ee3f4-e6d7-4e9b-b584-d4f50cc2925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:10.956981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee3f4-e6d7-4e9b-b584-d4f50cc2925a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.957274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee3f4-e6d7-4e9b-b584-d4f50cc2925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.957846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee3f4-e6d7-4e9b-b584-d4f50cc2925a admin admin] PATH_INFO: `/v3/projects/8e9fc694448743d38692a8b45dbd0053/users/7f95d6e99809412797f41196ec561535/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:10.961085 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:10.981091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ee3f4-e6d7-4e9b-b584-d4f50cc2925a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9fc694448743d38692a8b45dbd0053, user_id=7f95d6e99809412797f41196ec561535, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:10.985107 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ee3f4-e6d7-4e9b-b584-d4f50cc2925a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:10.989080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767b62-fefd-4134-be18-9291f4dd164a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:10.989741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767b62-fefd-4134-be18-9291f4dd164a service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:10.990154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767b62-fefd-4134-be18-9291f4dd164a service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:10.990677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767b62-fefd-4134-be18-9291f4dd164a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.008430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43767b62-fefd-4134-be18-9291f4dd164a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:11.010320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43767b62-fefd-4134-be18-9291f4dd164a service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:11.012314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 966/1938] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:10 2022] PUT /identity/v3/projects/8e9fc694448743d38692a8b45dbd0053/users/7f95d6e99809412797f41196ec561535/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:11.016386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ee3f4-e6d7-4e9b-b584-d4f50cc2925a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:11.027029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:11.028670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 973/1939] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:11.122745 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ee3f4-e6d7-4e9b-b584-d4f50cc2925a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:11.130349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb93e6-6b67-4a9d-a118-a2c3d1c7878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:11.131362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb93e6-6b67-4a9d-a118-a2c3d1c7878f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.131846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb93e6-6b67-4a9d-a118-a2c3d1c7878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.132308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb93e6-6b67-4a9d-a118-a2c3d1c7878f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.133516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb93e6-6b67-4a9d-a118-a2c3d1c7878f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:11.136307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb93e6-6b67-4a9d-a118-a2c3d1c7878f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:11.153186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767b62-fefd-4134-be18-9291f4dd164a service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:11.159022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 967/1940] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:11.166278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767b62-fefd-4134-be18-9291f4dd164a service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:11.172268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47403b1f-fda4-4ea2-a548-8ee104c8d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:11.173672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47403b1f-fda4-4ea2-a548-8ee104c8d2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.173965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47403b1f-fda4-4ea2-a548-8ee104c8d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.174281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47403b1f-fda4-4ea2-a548-8ee104c8d2e5 admin admin] PATH_INFO: `/v3/projects/8e9fc694448743d38692a8b45dbd0053/users/7f95d6e99809412797f41196ec561535/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.176499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47403b1f-fda4-4ea2-a548-8ee104c8d2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9fc694448743d38692a8b45dbd0053, user_id=7f95d6e99809412797f41196ec561535, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:11.179622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47403b1f-fda4-4ea2-a548-8ee104c8d2e5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:11.199405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 974/1941] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:11 2022] PUT /identity/v3/projects/8e9fc694448743d38692a8b45dbd0053/users/7f95d6e99809412797f41196ec561535/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:11.212212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47049e-54bb-49e8-bf2a-6635d9c67da4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.212943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47049e-54bb-49e8-bf2a-6635d9c67da4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.212943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47049e-54bb-49e8-bf2a-6635d9c67da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.244779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47403b1f-fda4-4ea2-a548-8ee104c8d2e5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:11.246885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-47403b1f-fda4-4ea2-a548-8ee104c8d2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:11.301297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cb47049e-54bb-49e8-bf2a-6635d9c67da4 None None] MFA Rules not processed for user `7f95d6e99809412797f41196ec561535`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:11.303357 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cb47049e-54bb-49e8-bf2a-6635d9c67da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:11.363995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47403b1f-fda4-4ea2-a548-8ee104c8d2e5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:11.370727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:11.372969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.373164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.374005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] PATH_INFO: `/v3/projects/3b83ab044a9b4628a2d20a3da81a10b0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.376979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b83ab044a9b4628a2d20a3da81a10b0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:11.379344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:11.447460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b83ab044a9b4628a2d20a3da81a10b0', 'request_id': 'req-06b9bf10-a09b-4a3d-b7df-9f5dda596518'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.447775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 968/1942] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:11.460000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47049e-54bb-49e8-bf2a-6635d9c67da4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:11.461349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b83ab044a9b4628a2d20a3da81a10b0', 'request_id': 'req-06b9bf10-a09b-4a3d-b7df-9f5dda596518'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.463007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cb47049e-54bb-49e8-bf2a-6635d9c67da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:11.479790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b83ab044a9b4628a2d20a3da81a10b0', 'request_id': 'req-06b9bf10-a09b-4a3d-b7df-9f5dda596518'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.481850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47049e-54bb-49e8-bf2a-6635d9c67da4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:11.492466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] The token cache is being invalidate because project 3b83ab044a9b4628a2d20a3da81a10b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:11.492859 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.493829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.495780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 975/1943] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:11 2022] DELETE /identity/v3/projects/3b83ab044a9b4628a2d20a3da81a10b0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:11.496702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:11.498847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:11.569845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:11.570794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.571241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.571525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] PATH_INFO: `/v3/projects/81f8387fed3243638f6724e934e5746e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.572768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f8387fed3243638f6724e934e5746e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:11.574774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:11.577971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf10-a09b-4a3d-b7df-9f5dda596518 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:11.582328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:11.583039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.583483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.583770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.586016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:11.593637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:11.620416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:11.656741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f8387fed3243638f6724e934e5746e', 'request_id': 'req-df5708c9-8517-47ed-ad82-4fcd9034b09f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.668710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f8387fed3243638f6724e934e5746e', 'request_id': 'req-df5708c9-8517-47ed-ad82-4fcd9034b09f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.674471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:11.677909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f8387fed3243638f6724e934e5746e', 'request_id': 'req-df5708c9-8517-47ed-ad82-4fcd9034b09f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.678255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:11.694465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 976/1944] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:11.695568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:11.696970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] The token cache is being invalidate because project 81f8387fed3243638f6724e934e5746e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:11.697103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:11.697274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.697998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df5708c9-8517-47ed-ad82-4fcd9034b09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.700041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 969/1945] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:11 2022] DELETE /identity/v3/projects/81f8387fed3243638f6724e934e5746e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:11.701743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4148d-7899-4cdb-9284-00fe221354ca None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.702077 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4148d-7899-4cdb-9284-00fe221354ca None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.702394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4148d-7899-4cdb-9284-00fe221354ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.715836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bdded-b6fa-4e16-9d9c-b1c8ec60026a service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:11.726747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4cc4148d-7899-4cdb-9284-00fe221354ca None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:11.728854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4cc4148d-7899-4cdb-9284-00fe221354ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:11.840542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 970/1946] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:11.841984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2416f0-dd0e-4526-97e0-2619a2ba61e6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.842326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2416f0-dd0e-4526-97e0-2619a2ba61e6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.842606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2416f0-dd0e-4526-97e0-2619a2ba61e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.851938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:11.853053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.854136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.855067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] PATH_INFO: `/v3/users/c54fbb17c23b429d85fea5c266ccdaad` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.856558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54fbb17c23b429d85fea5c266ccdaad)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:11.858683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:11.882806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5c2416f0-dd0e-4526-97e0-2619a2ba61e6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:11.884476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5c2416f0-dd0e-4526-97e0-2619a2ba61e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:11.897113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 971/1947] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:11.903909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7edd25-2fde-4f13-9260-51285319647f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.904635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7edd25-2fde-4f13-9260-51285319647f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.905140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7edd25-2fde-4f13-9260-51285319647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.929406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fe7edd25-2fde-4f13-9260-51285319647f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:11.930659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fe7edd25-2fde-4f13-9260-51285319647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:11.940290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 972/1948] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:11.945252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54fbb17c23b429d85fea5c266ccdaad'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.945431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf92db4-c70b-45ae-8205-25adcba223f9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:11.945594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf92db4-c70b-45ae-8205-25adcba223f9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:11.945882 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf92db4-c70b-45ae-8205-25adcba223f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:11.946616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54fbb17c23b429d85fea5c266ccdaad'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.947576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54fbb17c23b429d85fea5c266ccdaad'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.958184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54fbb17c23b429d85fea5c266ccdaad'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.969655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-582b761d-710e-489c-afe2-51360f34c5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54fbb17c23b429d85fea5c266ccdaad'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:11.980883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fcf92db4-c70b-45ae-8205-25adcba223f9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:11.983913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fcf92db4-c70b-45ae-8205-25adcba223f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.000514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 973/1949] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:12.002004 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf92db4-c70b-45ae-8205-25adcba223f9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.003877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fcf92db4-c70b-45ae-8205-25adcba223f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.022595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 977/1950] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:11 2022] DELETE /identity/v3/users/c54fbb17c23b429d85fea5c266ccdaad => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:12.024455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34540-f7ea-4621-ae82-764a36ce609b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.024746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34540-f7ea-4621-ae82-764a36ce609b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.025047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34540-f7ea-4621-ae82-764a36ce609b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.028465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 978/1951] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 12:58:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:58:12.029262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34540-f7ea-4621-ae82-764a36ce609b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.042366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf92db4-c70b-45ae-8205-25adcba223f9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.092237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:12.146573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87c578-a14d-4cef-9bb2-22a1f141544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.147377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87c578-a14d-4cef-9bb2-22a1f141544f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.147659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87c578-a14d-4cef-9bb2-22a1f141544f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.148124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87c578-a14d-4cef-9bb2-22a1f141544f admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.148872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87c578-a14d-4cef-9bb2-22a1f141544f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:12.149292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87c578-a14d-4cef-9bb2-22a1f141544f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:12.151882 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87c578-a14d-4cef-9bb2-22a1f141544f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:12.152836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34540-f7ea-4621-ae82-764a36ce609b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.158723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13d4e4-722f-4067-b2f2-ee2a26315103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.159368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13d4e4-722f-4067-b2f2-ee2a26315103 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.159653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13d4e4-722f-4067-b2f2-ee2a26315103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.159930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13d4e4-722f-4067-b2f2-ee2a26315103 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.161068 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13d4e4-722f-4067-b2f2-ee2a26315103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:12.161487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13d4e4-722f-4067-b2f2-ee2a26315103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:12.163292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13d4e4-722f-4067-b2f2-ee2a26315103 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:12.167098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 974/1952] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:58:12.169148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144ef43-38da-435b-b7f7-67e165a90433 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.169637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144ef43-38da-435b-b7f7-67e165a90433 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.170582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144ef43-38da-435b-b7f7-67e165a90433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.176909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 979/1953] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:58:12.180715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ee783-3f3b-47eb-b219-4dc9545e3768 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.180715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ee783-3f3b-47eb-b219-4dc9545e3768 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.180715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ee783-3f3b-47eb-b219-4dc9545e3768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.202181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0b3ee783-3f3b-47eb-b219-4dc9545e3768 None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:12.203539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0b3ee783-3f3b-47eb-b219-4dc9545e3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.223038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0144ef43-38da-435b-b7f7-67e165a90433 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:12.228909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0144ef43-38da-435b-b7f7-67e165a90433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.238992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 975/1954] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:12.238992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144ef43-38da-435b-b7f7-67e165a90433 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.274777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144ef43-38da-435b-b7f7-67e165a90433 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.286133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0158-cf41-49a1-8e47-42fb4d0cc539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.286773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0158-cf41-49a1-8e47-42fb4d0cc539 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.287062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0158-cf41-49a1-8e47-42fb4d0cc539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.287346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0158-cf41-49a1-8e47-42fb4d0cc539 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.288290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0158-cf41-49a1-8e47-42fb4d0cc539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:12.292947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0158-cf41-49a1-8e47-42fb4d0cc539 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:12.345520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 980/1955] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:12.346584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ee783-3f3b-47eb-b219-4dc9545e3768 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.350756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 976/1956] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:12 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:12.350756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0158-cf41-49a1-8e47-42fb4d0cc539 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.351135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3b2c0158-cf41-49a1-8e47-42fb4d0cc539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.357095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:12.358623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ee783-3f3b-47eb-b219-4dc9545e3768 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.423444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0158-cf41-49a1-8e47-42fb4d0cc539 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.427165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf5055-9861-4de6-82c9-0ad36cc50649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.427900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf5055-9861-4de6-82c9-0ad36cc50649 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.428251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf5055-9861-4de6-82c9-0ad36cc50649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.428532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf5055-9861-4de6-82c9-0ad36cc50649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.434479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf245e3a-ff27-48e0-92d6-744ca3781acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.435176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf245e3a-ff27-48e0-92d6-744ca3781acc admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.435459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf245e3a-ff27-48e0-92d6-744ca3781acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.435740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf245e3a-ff27-48e0-92d6-744ca3781acc admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.436446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf245e3a-ff27-48e0-92d6-744ca3781acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:12.438526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf245e3a-ff27-48e0-92d6-744ca3781acc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:12.469550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 981/1957] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:12 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:12.470623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf245e3a-ff27-48e0-92d6-744ca3781acc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.472589 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bf245e3a-ff27-48e0-92d6-744ca3781acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.499979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf5055-9861-4de6-82c9-0ad36cc50649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:12.501660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf5055-9861-4de6-82c9-0ad36cc50649 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:12.514175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 977/1958] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:12.514887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf5055-9861-4de6-82c9-0ad36cc50649 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.526264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:12.526470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf5055-9861-4de6-82c9-0ad36cc50649 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.571796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf245e3a-ff27-48e0-92d6-744ca3781acc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.588875 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.589994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.590441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.591297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] PATH_INFO: `/v3/users/d8c58a1aa585494e8653932a29fcbcc7` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.592699 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c58a1aa585494e8653932a29fcbcc7)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:12.596307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:12.653194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2105-5469-40c6-80b7-5e9cfc3c6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.654606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2105-5469-40c6-80b7-5e9cfc3c6ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.655320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2105-5469-40c6-80b7-5e9cfc3c6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.656057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2105-5469-40c6-80b7-5e9cfc3c6ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.657344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf2105-5469-40c6-80b7-5e9cfc3c6ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:12.660801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf2105-5469-40c6-80b7-5e9cfc3c6ed4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:12.683188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c58a1aa585494e8653932a29fcbcc7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:12.684477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c58a1aa585494e8653932a29fcbcc7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:12.685260 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c58a1aa585494e8653932a29fcbcc7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:12.694032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 978/1959] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:12 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:12.695414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2105-5469-40c6-80b7-5e9cfc3c6ed4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.698980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-daaf2105-5469-40c6-80b7-5e9cfc3c6ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.699473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c58a1aa585494e8653932a29fcbcc7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:12.723714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c58a1aa585494e8653932a29fcbcc7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:12.759587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 982/1960] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:12 2022] DELETE /identity/v3/users/d8c58a1aa585494e8653932a29fcbcc7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:12.761245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.763739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.776923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:12.861979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2105-5469-40c6-80b7-5e9cfc3c6ed4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.896120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96bf32-bbec-4308-ad66-4ca8f1403524 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.905247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2387-a8dd-45c9-8650-76f251a1a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.905973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2387-a8dd-45c9-8650-76f251a1a954 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.906370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2387-a8dd-45c9-8650-76f251a1a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.907010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2387-a8dd-45c9-8650-76f251a1a954 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.908749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2387-a8dd-45c9-8650-76f251a1a954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:12.912429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2387-a8dd-45c9-8650-76f251a1a954 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:12.946011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 983/1961] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:12 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:12.947686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2387-a8dd-45c9-8650-76f251a1a954 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:12.950021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6d8e2387-a8dd-45c9-8650-76f251a1a954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.965244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2387-a8dd-45c9-8650-76f251a1a954 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:12.972793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa69c4-399f-4d17-91b9-b166742c472a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.973484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa69c4-399f-4d17-91b9-b166742c472a service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.973770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa69c4-399f-4d17-91b9-b166742c472a service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.974052 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa69c4-399f-4d17-91b9-b166742c472a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.976705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b914d7-e520-428e-98ee-8aaa05a6e622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:12.977401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b914d7-e520-428e-98ee-8aaa05a6e622 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:12.977682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b914d7-e520-428e-98ee-8aaa05a6e622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:12.977958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b914d7-e520-428e-98ee-8aaa05a6e622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:12.978911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fbaa69c4-399f-4d17-91b9-b166742c472a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:12.981145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b914d7-e520-428e-98ee-8aaa05a6e622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:12.983711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b914d7-e520-428e-98ee-8aaa05a6e622 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.005137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 984/1962] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:13.006173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa69c4-399f-4d17-91b9-b166742c472a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:13.006686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60ba5-9185-435b-be9e-b09c1d332e53 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.007028 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60ba5-9185-435b-be9e-b09c1d332e53 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.007322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc60ba5-9185-435b-be9e-b09c1d332e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.008602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa69c4-399f-4d17-91b9-b166742c472a service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.028572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 979/1963] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:13.029742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa69c4-399f-4d17-91b9-b166742c472a service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.047165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa69c4-399f-4d17-91b9-b166742c472a service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:13.053377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e1229-f76f-47a5-9250-29f1a3b181ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:13.053963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6bc60ba5-9185-435b-be9e-b09c1d332e53 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:13.054842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e1229-f76f-47a5-9250-29f1a3b181ff admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.055145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e1229-f76f-47a5-9250-29f1a3b181ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.055407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e1229-f76f-47a5-9250-29f1a3b181ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.057232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e1229-f76f-47a5-9250-29f1a3b181ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:13.057612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6bc60ba5-9185-435b-be9e-b09c1d332e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:13.059608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e1229-f76f-47a5-9250-29f1a3b181ff admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.076111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 980/1964] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:13.077594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e1229-f76f-47a5-9250-29f1a3b181ff admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.080918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 985/1965] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:13.087420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60ba5-9185-435b-be9e-b09c1d332e53 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.092164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e1229-f76f-47a5-9250-29f1a3b181ff admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:13.100301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a230b-dd18-42bf-9453-28bca97f768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:13.101896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a230b-dd18-42bf-9453-28bca97f768b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.102249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a230b-dd18-42bf-9453-28bca97f768b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.102932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a230b-dd18-42bf-9453-28bca97f768b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.103795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a230b-dd18-42bf-9453-28bca97f768b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:13.105875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a230b-dd18-42bf-9453-28bca97f768b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.117499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc60ba5-9185-435b-be9e-b09c1d332e53 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:13.122112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 981/1966] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:13.123634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a230b-dd18-42bf-9453-28bca97f768b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.128125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-191a230b-dd18-42bf-9453-28bca97f768b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:13.133736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5102d-5f60-48fc-a406-76fe4daf67e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:13.135148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5102d-5f60-48fc-a406-76fe4daf67e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.135433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5102d-5f60-48fc-a406-76fe4daf67e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.135714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5102d-5f60-48fc-a406-76fe4daf67e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.137363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5102d-5f60-48fc-a406-76fe4daf67e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:13.144164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5102d-5f60-48fc-a406-76fe4daf67e9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.182112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 986/1967] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:13.183030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5102d-5f60-48fc-a406-76fe4daf67e9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.211355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5102d-5f60-48fc-a406-76fe4daf67e9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:13.217895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c4ae3-e9b8-4071-847f-7c9ac0f49c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:13.218860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c4ae3-e9b8-4071-847f-7c9ac0f49c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.219141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c4ae3-e9b8-4071-847f-7c9ac0f49c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.219413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c4ae3-e9b8-4071-847f-7c9ac0f49c4c admin admin] PATH_INFO: `/v3/projects/1da47e58500145d180826fb988ca8cda/users/701cb7d5036240eb94d534fa5b1b00ff/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.231166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a230b-dd18-42bf-9453-28bca97f768b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:13.243359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59e88-ed4e-43b7-a0b1-8d0b68323eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:13.244714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59e88-ed4e-43b7-a0b1-8d0b68323eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.246286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59e88-ed4e-43b7-a0b1-8d0b68323eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.247456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59e88-ed4e-43b7-a0b1-8d0b68323eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.249785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:13.257103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c4ae3-e9b8-4071-847f-7c9ac0f49c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da47e58500145d180826fb988ca8cda, user_id=701cb7d5036240eb94d534fa5b1b00ff, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:13.274325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c4ae3-e9b8-4071-847f-7c9ac0f49c4c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.275506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c59e88-ed4e-43b7-a0b1-8d0b68323eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:13.281492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c59e88-ed4e-43b7-a0b1-8d0b68323eb3 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.291929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 987/1968] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:13 2022] PUT /identity/v3/projects/1da47e58500145d180826fb988ca8cda/users/701cb7d5036240eb94d534fa5b1b00ff/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:13.293037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c4ae3-e9b8-4071-847f-7c9ac0f49c4c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.320586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 982/1969] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:13.324071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc0556-f887-4b52-8817-0affe2c55fe7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.324398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc0556-f887-4b52-8817-0affe2c55fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.324640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc0556-f887-4b52-8817-0affe2c55fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.362627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6dbc0556-f887-4b52-8817-0affe2c55fe7 None None] MFA Rules not processed for user `701cb7d5036240eb94d534fa5b1b00ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:13.364189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6dbc0556-f887-4b52-8817-0affe2c55fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:13.429408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:13.440868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c4ae3-e9b8-4071-847f-7c9ac0f49c4c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:13.449165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5afb47-4f00-4101-84a5-2c34d36d7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:13.450136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5afb47-4f00-4101-84a5-2c34d36d7656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.450538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5afb47-4f00-4101-84a5-2c34d36d7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.450821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5afb47-4f00-4101-84a5-2c34d36d7656 admin admin] PATH_INFO: `/v3/projects/b520049159af47d182c8500e9b80b280/users/552dcf6b62fa49eda7fef73fb5e5671b/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.472526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5afb47-4f00-4101-84a5-2c34d36d7656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b520049159af47d182c8500e9b80b280, user_id=552dcf6b62fa49eda7fef73fb5e5671b, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:13.477345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5afb47-4f00-4101-84a5-2c34d36d7656 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.482487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 983/1970] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:13.487809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc0556-f887-4b52-8817-0affe2c55fe7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.494727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 988/1971] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:13 2022] PUT /identity/v3/projects/b520049159af47d182c8500e9b80b280/users/552dcf6b62fa49eda7fef73fb5e5671b/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:13.507344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc0556-f887-4b52-8817-0affe2c55fe7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:13.509634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1cfa8-388a-4e4d-985b-324f0d2b5943 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.509928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1cfa8-388a-4e4d-985b-324f0d2b5943 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.510251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1cfa8-388a-4e4d-985b-324f0d2b5943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.552595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fcf1cfa8-388a-4e4d-985b-324f0d2b5943 None None] MFA Rules not processed for user `552dcf6b62fa49eda7fef73fb5e5671b`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:13.554300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fcf1cfa8-388a-4e4d-985b-324f0d2b5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:13.647180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e6b2-fcfa-40c6-899f-05bd7e29361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:13.649669 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e6b2-fcfa-40c6-899f-05bd7e29361e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.649971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e6b2-fcfa-40c6-899f-05bd7e29361e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.650279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422e6b2-fcfa-40c6-899f-05bd7e29361e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.656901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422e6b2-fcfa-40c6-899f-05bd7e29361e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:13.664799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422e6b2-fcfa-40c6-899f-05bd7e29361e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.707636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 989/1972] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:13.720704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1cfa8-388a-4e4d-985b-324f0d2b5943 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.723167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fcf1cfa8-388a-4e4d-985b-324f0d2b5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:13.752557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 984/1973] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:13 2022] POST /identity/v3/projects => generated 379 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:13.754309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e6b2-fcfa-40c6-899f-05bd7e29361e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.915178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1cfa8-388a-4e4d-985b-324f0d2b5943 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:13.918748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422e6b2-fcfa-40c6-899f-05bd7e29361e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:13.927719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4e00-15de-44fa-972d-c4fcbf7f3850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:13.928892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4e00-15de-44fa-972d-c4fcbf7f3850 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:13.929191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4e00-15de-44fa-972d-c4fcbf7f3850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:13.929536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4e00-15de-44fa-972d-c4fcbf7f3850 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:13.931017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e4e00-15de-44fa-972d-c4fcbf7f3850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:13.933375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e4e00-15de-44fa-972d-c4fcbf7f3850 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:13.943619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:13.986230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 985/1974] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:13 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:13.986230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4e00-15de-44fa-972d-c4fcbf7f3850 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:13.994725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-210e4e00-15de-44fa-972d-c4fcbf7f3850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:14.018278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4e00-15de-44fa-972d-c4fcbf7f3850 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:14.032769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c949b3-7d43-4649-ac84-e02be2277950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:14.034246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c949b3-7d43-4649-ac84-e02be2277950 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:14.034556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c949b3-7d43-4649-ac84-e02be2277950 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:14.036775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c949b3-7d43-4649-ac84-e02be2277950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:14.039123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:14.040602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:14.040602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:14.040842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] PATH_INFO: `/v3/projects/9de7aaf88af741dd84a557799308b743` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:14.042363 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de7aaf88af741dd84a557799308b743)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:14.044589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:14.131050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:14.135124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de7aaf88af741dd84a557799308b743', 'request_id': 'req-e405f226-7788-42b7-9ac2-3bca83db0a33'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.149654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de7aaf88af741dd84a557799308b743', 'request_id': 'req-e405f226-7788-42b7-9ac2-3bca83db0a33'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.153951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c949b3-7d43-4649-ac84-e02be2277950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:14.156676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c949b3-7d43-4649-ac84-e02be2277950 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:14.164993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de7aaf88af741dd84a557799308b743', 'request_id': 'req-e405f226-7788-42b7-9ac2-3bca83db0a33'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.173340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 990/1975] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:58:14.183583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c949b3-7d43-4649-ac84-e02be2277950 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:14.202485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] The token cache is being invalidate because project 9de7aaf88af741dd84a557799308b743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:14.202864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.206452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.211936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 986/1976] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:13 2022] DELETE /identity/v3/projects/9de7aaf88af741dd84a557799308b743 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:14.217313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:14.218004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c949b3-7d43-4649-ac84-e02be2277950 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:14.220923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:14.378500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405f226-7788-42b7-9ac2-3bca83db0a33 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:14.386041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:14.387386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:14.387878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:14.388353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] PATH_INFO: `/v3/users/d16520e6b5674cbead65f1882caaee0c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:14.390393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16520e6b5674cbead65f1882caaee0c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:14.393717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:14.394341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ef8a3-768b-45bd-88ef-36178b6abe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:14.395140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ef8a3-768b-45bd-88ef-36178b6abe2e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:14.395481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ef8a3-768b-45bd-88ef-36178b6abe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:14.395767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ef8a3-768b-45bd-88ef-36178b6abe2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:14.396603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ef8a3-768b-45bd-88ef-36178b6abe2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:14.398725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ef8a3-768b-45bd-88ef-36178b6abe2e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:14.415342 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 991/1977] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:14.415342 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ef8a3-768b-45bd-88ef-36178b6abe2e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:14.417624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3c7ef8a3-768b-45bd-88ef-36178b6abe2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:14.444160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ef8a3-768b-45bd-88ef-36178b6abe2e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:14.450375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:14.451305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:14.451656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:14.452186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] PATH_INFO: `/v3/projects/4996ec5c3d74469a89f5dcbd269f5e25` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:14.453571 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4996ec5c3d74469a89f5dcbd269f5e25)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:14.456289 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:14.470310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16520e6b5674cbead65f1882caaee0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.492967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16520e6b5674cbead65f1882caaee0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.493810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16520e6b5674cbead65f1882caaee0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.507532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16520e6b5674cbead65f1882caaee0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.524073 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4996ec5c3d74469a89f5dcbd269f5e25', 'request_id': 'req-b1d17155-1e62-4a61-9d27-458b0f8120df'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.526443 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16520e6b5674cbead65f1882caaee0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.533368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4996ec5c3d74469a89f5dcbd269f5e25', 'request_id': 'req-b1d17155-1e62-4a61-9d27-458b0f8120df'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.538959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 987/1978] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:14 2022] DELETE /identity/v3/users/d16520e6b5674cbead65f1882caaee0c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:14.540088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:14.541753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:14.563578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4996ec5c3d74469a89f5dcbd269f5e25', 'request_id': 'req-b1d17155-1e62-4a61-9d27-458b0f8120df'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.566877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:14.586133 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] The token cache is being invalidate because project 4996ec5c3d74469a89f5dcbd269f5e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:14.586880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.588014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.595608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 992/1979] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:14 2022] DELETE /identity/v3/projects/4996ec5c3d74469a89f5dcbd269f5e25 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:14.598351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:14.599998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:14.685955 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:14.721674 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af813dc-c04a-4db0-9eda-5d2da4e56b07 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:14.734924 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad849b-5a32-403c-8665-d21a22057811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:14.737181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad849b-5a32-403c-8665-d21a22057811 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:14.738625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad849b-5a32-403c-8665-d21a22057811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:14.738991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad849b-5a32-403c-8665-d21a22057811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:14.741297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad849b-5a32-403c-8665-d21a22057811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:14.744780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad849b-5a32-403c-8665-d21a22057811 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:14.768108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 988/1980] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:14.772341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad849b-5a32-403c-8665-d21a22057811 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:14.774772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1aad849b-5a32-403c-8665-d21a22057811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:14.789323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad849b-5a32-403c-8665-d21a22057811 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:14.789545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d17155-1e62-4a61-9d27-458b0f8120df admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:14.796937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa28f82-7447-4cfc-9cd7-0354d838657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:14.799384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa28f82-7447-4cfc-9cd7-0354d838657b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:14.799384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa28f82-7447-4cfc-9cd7-0354d838657b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:14.799384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa28f82-7447-4cfc-9cd7-0354d838657b admin admin] PATH_INFO: `/v3/projects/b009dcf19b634148bb874b9b7572b5b6/users/1ac4dcfa7df947219bebd52e748e8cf3/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:14.801078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:14.802131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:14.803852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:14.806322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] PATH_INFO: `/v3/users/7f95d6e99809412797f41196ec561535` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:14.808435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f95d6e99809412797f41196ec561535)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:14.812698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:14.820758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa28f82-7447-4cfc-9cd7-0354d838657b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b009dcf19b634148bb874b9b7572b5b6, user_id=1ac4dcfa7df947219bebd52e748e8cf3, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:14.825172 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa28f82-7447-4cfc-9cd7-0354d838657b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:14.862237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 989/1981] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:14 2022] PUT /identity/v3/projects/b009dcf19b634148bb874b9b7572b5b6/users/1ac4dcfa7df947219bebd52e748e8cf3/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:14.868594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427363-65f3-4cf0-8099-5d452f889ff8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:14.869337 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427363-65f3-4cf0-8099-5d452f889ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:14.869533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a427363-65f3-4cf0-8099-5d452f889ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:14.939628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f95d6e99809412797f41196ec561535'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.941577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f95d6e99809412797f41196ec561535'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.942658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9a427363-65f3-4cf0-8099-5d452f889ff8 None None] MFA Rules not processed for user `1ac4dcfa7df947219bebd52e748e8cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:14.943331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f95d6e99809412797f41196ec561535'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.943892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9a427363-65f3-4cf0-8099-5d452f889ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:14.965488 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f95d6e99809412797f41196ec561535'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:14.979401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f95d6e99809412797f41196ec561535'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.036598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 993/1982] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:14 2022] DELETE /identity/v3/users/7f95d6e99809412797f41196ec561535 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:15.077869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 990/1983] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:15.082478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:15.084098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:15.107337 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a427363-65f3-4cf0-8099-5d452f889ff8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:15.108976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9a427363-65f3-4cf0-8099-5d452f889ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:15.192732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d07072-523a-48da-9cb8-a8a2e4eca4b4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:15.198577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a196011-5b6b-4201-bd12-3798b4244bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:15.199428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a196011-5b6b-4201-bd12-3798b4244bea admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:15.200022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a196011-5b6b-4201-bd12-3798b4244bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:15.200447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a196011-5b6b-4201-bd12-3798b4244bea admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:15.201815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a196011-5b6b-4201-bd12-3798b4244bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:15.204943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a196011-5b6b-4201-bd12-3798b4244bea admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:15.227979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:15.248024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 994/1984] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:15 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:15.252278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a196011-5b6b-4201-bd12-3798b4244bea admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:15.260987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a427363-65f3-4cf0-8099-5d452f889ff8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:15.365602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a196011-5b6b-4201-bd12-3798b4244bea admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:15.370963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4c906-a67d-4f3f-9986-0fc8e72e8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:15.371784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4c906-a67d-4f3f-9986-0fc8e72e8cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:15.372138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4c906-a67d-4f3f-9986-0fc8e72e8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:15.372484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4c906-a67d-4f3f-9986-0fc8e72e8cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:15.373386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4c906-a67d-4f3f-9986-0fc8e72e8cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:15.376084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4c906-a67d-4f3f-9986-0fc8e72e8cfb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:15.379591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:15.380766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:15.381771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:15.382404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] PATH_INFO: `/v3/projects/636b811749ed49d9a8743835952e727b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:15.384089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=636b811749ed49d9a8743835952e727b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:15.396149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:15.396149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:15.409880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 995/1985] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:15 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:15.413523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4c906-a67d-4f3f-9986-0fc8e72e8cfb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:15.424907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4c906-a67d-4f3f-9986-0fc8e72e8cfb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:15.430706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3041b04-8cae-4cd7-aa72-cb8fe994893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:15.431398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3041b04-8cae-4cd7-aa72-cb8fe994893e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:15.431689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3041b04-8cae-4cd7-aa72-cb8fe994893e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:15.431955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3041b04-8cae-4cd7-aa72-cb8fe994893e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:15.432681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3041b04-8cae-4cd7-aa72-cb8fe994893e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:15.434413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3041b04-8cae-4cd7-aa72-cb8fe994893e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:15.447842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 996/1986] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:58:15.452463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3041b04-8cae-4cd7-aa72-cb8fe994893e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:15.459994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636b811749ed49d9a8743835952e727b', 'request_id': 'req-ccc001de-05bd-4e1d-9f29-3b124cd67cae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.465739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636b811749ed49d9a8743835952e727b', 'request_id': 'req-ccc001de-05bd-4e1d-9f29-3b124cd67cae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.468617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3041b04-8cae-4cd7-aa72-cb8fe994893e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:15.472295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636b811749ed49d9a8743835952e727b', 'request_id': 'req-ccc001de-05bd-4e1d-9f29-3b124cd67cae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.490586 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] The token cache is being invalidate because project 636b811749ed49d9a8743835952e727b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:15.490959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.491945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.494379 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 991/1987] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:15 2022] DELETE /identity/v3/projects/636b811749ed49d9a8743835952e727b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:15.495724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:15.497592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:15.540444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32799ab-518a-4902-9f26-075ed0b07804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:15.541267 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32799ab-518a-4902-9f26-075ed0b07804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:15.541548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32799ab-518a-4902-9f26-075ed0b07804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:15.541822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32799ab-518a-4902-9f26-075ed0b07804 admin admin] PATH_INFO: `/v3/projects/4ee742b72adf471fb8bf47cd39cc32ee/users/8e27cde4a82c4203a9527ae2c80a11c8/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:15.557236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32799ab-518a-4902-9f26-075ed0b07804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee742b72adf471fb8bf47cd39cc32ee, user_id=8e27cde4a82c4203a9527ae2c80a11c8, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:15.560175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32799ab-518a-4902-9f26-075ed0b07804 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:15.574597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc001de-05bd-4e1d-9f29-3b124cd67cae admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:15.580864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 997/1988] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:15 2022] PUT /identity/v3/projects/4ee742b72adf471fb8bf47cd39cc32ee/users/8e27cde4a82c4203a9527ae2c80a11c8/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:15.581864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32799ab-518a-4902-9f26-075ed0b07804 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:15.583609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e32799ab-518a-4902-9f26-075ed0b07804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:15.635621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:15.636528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:15.636838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:15.637112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] PATH_INFO: `/v3/projects/8e9fc694448743d38692a8b45dbd0053` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:15.638465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9fc694448743d38692a8b45dbd0053)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:15.640454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:15.649831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:15.653916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32799ab-518a-4902-9f26-075ed0b07804 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:15.660112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:15.661331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:15.661331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:15.661600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] PATH_INFO: `/v3/users/1b422260998c484db7fa650e973ad3d0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:15.662817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b422260998c484db7fa650e973ad3d0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:15.664786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:15.689734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:15.697811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9fc694448743d38692a8b45dbd0053', 'request_id': 'req-0588244e-1272-4acd-b80a-ba98a91d67e2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.704740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9fc694448743d38692a8b45dbd0053', 'request_id': 'req-0588244e-1272-4acd-b80a-ba98a91d67e2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.713665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9fc694448743d38692a8b45dbd0053', 'request_id': 'req-0588244e-1272-4acd-b80a-ba98a91d67e2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.734051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b422260998c484db7fa650e973ad3d0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.738494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] The token cache is being invalidate because project 8e9fc694448743d38692a8b45dbd0053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:15.738494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.739575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.743016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b422260998c484db7fa650e973ad3d0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.743199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 992/1989] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:15 2022] DELETE /identity/v3/projects/8e9fc694448743d38692a8b45dbd0053 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:15.744355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:15.748127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b422260998c484db7fa650e973ad3d0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.748693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:15.766163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b422260998c484db7fa650e973ad3d0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.783219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e98c70dc-d30f-4f2e-9fe1-403f1f82a107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b422260998c484db7fa650e973ad3d0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:15.826849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 998/1990] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:15 2022] DELETE /identity/v3/users/1b422260998c484db7fa650e973ad3d0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:15.828612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f6fec-e0f6-49be-9247-e953e0f4000c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:15.828916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f6fec-e0f6-49be-9247-e953e0f4000c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:15.829253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f6fec-e0f6-49be-9247-e953e0f4000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:15.860532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-df2f6fec-e0f6-49be-9247-e953e0f4000c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:15.862184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-df2f6fec-e0f6-49be-9247-e953e0f4000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:15.917554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588244e-1272-4acd-b80a-ba98a91d67e2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:15.979345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 999/1991] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:15.984144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b40cf-96ed-453a-9d88-0b2fa3ffc20c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:15.984500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b40cf-96ed-453a-9d88-0b2fa3ffc20c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:15.984752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b40cf-96ed-453a-9d88-0b2fa3ffc20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.026120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-746b40cf-96ed-453a-9d88-0b2fa3ffc20c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:16.027924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-746b40cf-96ed-453a-9d88-0b2fa3ffc20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:16.039142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1000/1992] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:16.043828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b40cf-96ed-453a-9d88-0b2fa3ffc20c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.068047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b40cf-96ed-453a-9d88-0b2fa3ffc20c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.076547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe32d3-8f81-487f-9f56-1d9ee339daac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.080422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe32d3-8f81-487f-9f56-1d9ee339daac admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.080422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe32d3-8f81-487f-9f56-1d9ee339daac admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.080681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe32d3-8f81-487f-9f56-1d9ee339daac admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.081428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe32d3-8f81-487f-9f56-1d9ee339daac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:16.083234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe32d3-8f81-487f-9f56-1d9ee339daac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.089049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe32d3-8f81-487f-9f56-1d9ee339daac admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.106249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5611-01e2-4e15-814a-435859c1e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.106249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5611-01e2-4e15-814a-435859c1e2da admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.106249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5611-01e2-4e15-814a-435859c1e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.106249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5611-01e2-4e15-814a-435859c1e2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.106989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5611-01e2-4e15-814a-435859c1e2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.110038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5611-01e2-4e15-814a-435859c1e2da admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.121121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1001/1993] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:58:16.126163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe32d3-8f81-487f-9f56-1d9ee339daac admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.144452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe32d3-8f81-487f-9f56-1d9ee339daac admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.147854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 993/1994] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:16.149558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5611-01e2-4e15-814a-435859c1e2da admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.155128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-60ff5611-01e2-4e15-814a-435859c1e2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:16.163504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf626b5-a4b1-4dce-a4f6-5ed0393e3df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.164637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf626b5-a4b1-4dce-a4f6-5ed0393e3df2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.165027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf626b5-a4b1-4dce-a4f6-5ed0393e3df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.165487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf626b5-a4b1-4dce-a4f6-5ed0393e3df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.166535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf626b5-a4b1-4dce-a4f6-5ed0393e3df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.169133 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf626b5-a4b1-4dce-a4f6-5ed0393e3df2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.195894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5611-01e2-4e15-814a-435859c1e2da admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.209073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f699176-0107-4b65-8bc9-888fc42dba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.210384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f699176-0107-4b65-8bc9-888fc42dba46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.210746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f699176-0107-4b65-8bc9-888fc42dba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.211111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f699176-0107-4b65-8bc9-888fc42dba46 admin admin] PATH_INFO: `/v3/projects/4ee742b72adf471fb8bf47cd39cc32ee/users/8e27cde4a82c4203a9527ae2c80a11c8/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.215484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f699176-0107-4b65-8bc9-888fc42dba46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee742b72adf471fb8bf47cd39cc32ee, user_id=8e27cde4a82c4203a9527ae2c80a11c8, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.220907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f699176-0107-4b65-8bc9-888fc42dba46 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.230217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1002/1995] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:16 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:16.234381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf626b5-a4b1-4dce-a4f6-5ed0393e3df2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.245527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 994/1996] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:16 2022] PUT /identity/v3/projects/4ee742b72adf471fb8bf47cd39cc32ee/users/8e27cde4a82c4203a9527ae2c80a11c8/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:16.256269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75982a37-d1a0-4631-9d20-91f0b11cec62 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.256519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75982a37-d1a0-4631-9d20-91f0b11cec62 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.256763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75982a37-d1a0-4631-9d20-91f0b11cec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.288218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-75982a37-d1a0-4631-9d20-91f0b11cec62 None None] MFA Rules not processed for user `8e27cde4a82c4203a9527ae2c80a11c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:16.289613 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-75982a37-d1a0-4631-9d20-91f0b11cec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:16.304379 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:16.349847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf626b5-a4b1-4dce-a4f6-5ed0393e3df2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.421761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:16.463835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d7983-d6fb-4a83-9ee6-5ca1bf76d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.464536 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d7983-d6fb-4a83-9ee6-5ca1bf76d658 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.464816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d7983-d6fb-4a83-9ee6-5ca1bf76d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.465091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d7983-d6fb-4a83-9ee6-5ca1bf76d658 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.465894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d7983-d6fb-4a83-9ee6-5ca1bf76d658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.468516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d7983-d6fb-4a83-9ee6-5ca1bf76d658 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.470357 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 995/1997] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:16.484050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75982a37-d1a0-4631-9d20-91f0b11cec62 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.486206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-75982a37-d1a0-4631-9d20-91f0b11cec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:16.523547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1003/1998] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:16 2022] POST /identity/v3/users => generated 284 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:16.528834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d7983-d6fb-4a83-9ee6-5ca1bf76d658 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.558208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d7983-d6fb-4a83-9ee6-5ca1bf76d658 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.571499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96c35b-d544-4dce-8d2d-e3ccc7b77a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.573568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96c35b-d544-4dce-8d2d-e3ccc7b77a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.575710 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96c35b-d544-4dce-8d2d-e3ccc7b77a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.576364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96c35b-d544-4dce-8d2d-e3ccc7b77a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.577716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96c35b-d544-4dce-8d2d-e3ccc7b77a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.583619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96c35b-d544-4dce-8d2d-e3ccc7b77a50 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.611232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75982a37-d1a0-4631-9d20-91f0b11cec62 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.616450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1004/1999] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:58:16.616450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96c35b-d544-4dce-8d2d-e3ccc7b77a50 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.625441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2f96c35b-d544-4dce-8d2d-e3ccc7b77a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:16.630397 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a69017-89ff-4bda-9292-aca7f6889b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.631971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69017-89ff-4bda-9292-aca7f6889b5b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.633730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69017-89ff-4bda-9292-aca7f6889b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.634116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69017-89ff-4bda-9292-aca7f6889b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.648301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a69017-89ff-4bda-9292-aca7f6889b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.649392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96c35b-d544-4dce-8d2d-e3ccc7b77a50 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.651962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a69017-89ff-4bda-9292-aca7f6889b5b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.657029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.658457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.658675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.659403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] PATH_INFO: `/v3/projects/7585fdca4505496a9086fc37b65cf9d0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.660882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7585fdca4505496a9086fc37b65cf9d0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.663377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.680033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 996/2000] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:16.681138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a69017-89ff-4bda-9292-aca7f6889b5b service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.713593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a69017-89ff-4bda-9292-aca7f6889b5b service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.726251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793f8c4-d039-474b-a9b4-d895f1f8d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.727292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793f8c4-d039-474b-a9b4-d895f1f8d7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.727795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793f8c4-d039-474b-a9b4-d895f1f8d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.728262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793f8c4-d039-474b-a9b4-d895f1f8d7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.729558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793f8c4-d039-474b-a9b4-d895f1f8d7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.731583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793f8c4-d039-474b-a9b4-d895f1f8d7a9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.750076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 997/2001] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:16.750076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793f8c4-d039-474b-a9b4-d895f1f8d7a9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.767586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7585fdca4505496a9086fc37b65cf9d0', 'request_id': 'req-495963ec-2503-4040-a71b-75178b4a5c8d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:16.771283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793f8c4-d039-474b-a9b4-d895f1f8d7a9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.780823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7585fdca4505496a9086fc37b65cf9d0', 'request_id': 'req-495963ec-2503-4040-a71b-75178b4a5c8d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:16.795412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7585fdca4505496a9086fc37b65cf9d0', 'request_id': 'req-495963ec-2503-4040-a71b-75178b4a5c8d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:16.813478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] The token cache is being invalidate because project 7585fdca4505496a9086fc37b65cf9d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:16.814029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:16.815268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:16.817346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1005/2002] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:16 2022] DELETE /identity/v3/projects/7585fdca4505496a9086fc37b65cf9d0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:16.824742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:16.826923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:16.848021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71ea0d-9a79-4cc3-960f-b703925dd4b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.848845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71ea0d-9a79-4cc3-960f-b703925dd4b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.849197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71ea0d-9a79-4cc3-960f-b703925dd4b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.849657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71ea0d-9a79-4cc3-960f-b703925dd4b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.851653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8c71ea0d-9a79-4cc3-960f-b703925dd4b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:16.908603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:16.920647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71ea0d-9a79-4cc3-960f-b703925dd4b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.922563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71ea0d-9a79-4cc3-960f-b703925dd4b3 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.929009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495963ec-2503-4040-a71b-75178b4a5c8d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:16.932765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 998/2003] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:16.933686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c9098-977f-497e-90be-0ee43be50714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:16.933873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482508b-9464-4da6-829e-67fa291551f9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.934227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482508b-9464-4da6-829e-67fa291551f9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.934507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482508b-9464-4da6-829e-67fa291551f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.934635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9098-977f-497e-90be-0ee43be50714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.934900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9098-977f-497e-90be-0ee43be50714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.935173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9098-977f-497e-90be-0ee43be50714 admin admin] PATH_INFO: `/v3/projects/00b18aee8e054f3788526e48f771ac43/users/08b9e0990bf64d8fb3a2e8e737fae892/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.952794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c9098-977f-497e-90be-0ee43be50714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b18aee8e054f3788526e48f771ac43, user_id=08b9e0990bf64d8fb3a2e8e737fae892, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:16.953911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d482508b-9464-4da6-829e-67fa291551f9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:16.955401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d482508b-9464-4da6-829e-67fa291551f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:16.955971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c9098-977f-497e-90be-0ee43be50714 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:16.967422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 999/2004] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:16.975035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1006/2005] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:16 2022] PUT /identity/v3/projects/00b18aee8e054f3788526e48f771ac43/users/08b9e0990bf64d8fb3a2e8e737fae892/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:16.980316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76664bd-726a-440c-b912-39d868882205 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.980698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76664bd-726a-440c-b912-39d868882205 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.981048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76664bd-726a-440c-b912-39d868882205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:16.991814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b1b17-cae8-4e87-9b16-0a9cf72e3d8e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:16.992111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b1b17-cae8-4e87-9b16-0a9cf72e3d8e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:16.992393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b1b17-cae8-4e87-9b16-0a9cf72e3d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.013196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a76664bd-726a-440c-b912-39d868882205 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:17.014570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a76664bd-726a-440c-b912-39d868882205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:17.025641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e90b1b17-cae8-4e87-9b16-0a9cf72e3d8e None None] MFA Rules not processed for user `08b9e0990bf64d8fb3a2e8e737fae892`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:17.027098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e90b1b17-cae8-4e87-9b16-0a9cf72e3d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:17.038940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:17.096710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1000/2006] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:17.097823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76664bd-726a-440c-b912-39d868882205 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.108012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76664bd-726a-440c-b912-39d868882205 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.112711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1007/2007] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:17.115567 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b102693-b79e-4eb4-ab5f-40bcad8c90ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.116348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b102693-b79e-4eb4-ab5f-40bcad8c90ad admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.116478 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b102693-b79e-4eb4-ab5f-40bcad8c90ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.116835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b102693-b79e-4eb4-ab5f-40bcad8c90ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.117592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b102693-b79e-4eb4-ab5f-40bcad8c90ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:17.118361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b102693-b79e-4eb4-ab5f-40bcad8c90ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.119644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b102693-b79e-4eb4-ab5f-40bcad8c90ad admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.123705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b1b17-cae8-4e87-9b16-0a9cf72e3d8e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.147991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1001/2008] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:58:17.153583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b102693-b79e-4eb4-ab5f-40bcad8c90ad admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.158574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b1b17-cae8-4e87-9b16-0a9cf72e3d8e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.163739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4141e96-ed9a-4d7b-bf96-d3c1ddd7e2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.164457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4141e96-ed9a-4d7b-bf96-d3c1ddd7e2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.164777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4141e96-ed9a-4d7b-bf96-d3c1ddd7e2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.165054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4141e96-ed9a-4d7b-bf96-d3c1ddd7e2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.166113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4141e96-ed9a-4d7b-bf96-d3c1ddd7e2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.168062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4141e96-ed9a-4d7b-bf96-d3c1ddd7e2f7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.170326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b102693-b79e-4eb4-ab5f-40bcad8c90ad admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.176403 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc1b87-3533-48de-9f02-7dd4ebda999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.177579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc1b87-3533-48de-9f02-7dd4ebda999d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.177579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc1b87-3533-48de-9f02-7dd4ebda999d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.177805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc1b87-3533-48de-9f02-7dd4ebda999d admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.178487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc1b87-3533-48de-9f02-7dd4ebda999d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.181937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc1b87-3533-48de-9f02-7dd4ebda999d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.210409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1008/2009] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:17 2022] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:17.214823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4141e96-ed9a-4d7b-bf96-d3c1ddd7e2f7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.216999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1002/2010] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:17 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:17.223163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc1b87-3533-48de-9f02-7dd4ebda999d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.341646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4141e96-ed9a-4d7b-bf96-d3c1ddd7e2f7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.358727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc1b87-3533-48de-9f02-7dd4ebda999d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.368427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f310f7-baf6-47c3-959b-5c884249467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.369761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f310f7-baf6-47c3-959b-5c884249467c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.370247 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f310f7-baf6-47c3-959b-5c884249467c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.370602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f310f7-baf6-47c3-959b-5c884249467c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.371469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f310f7-baf6-47c3-959b-5c884249467c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.373787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f310f7-baf6-47c3-959b-5c884249467c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.408036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1003/2011] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:17 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:17.409537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f310f7-baf6-47c3-959b-5c884249467c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.425769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:17.443335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f310f7-baf6-47c3-959b-5c884249467c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.464544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa982b-8705-4fca-818c-3667aa142744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.465164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa982b-8705-4fca-818c-3667aa142744 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.465695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa982b-8705-4fca-818c-3667aa142744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.466393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa982b-8705-4fca-818c-3667aa142744 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.467390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988003e3-cc62-4096-8bad-154342563c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.468071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa982b-8705-4fca-818c-3667aa142744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.468188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988003e3-cc62-4096-8bad-154342563c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.468477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988003e3-cc62-4096-8bad-154342563c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.468759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988003e3-cc62-4096-8bad-154342563c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.469505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988003e3-cc62-4096-8bad-154342563c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.471352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa982b-8705-4fca-818c-3667aa142744 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.471754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988003e3-cc62-4096-8bad-154342563c4a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.505798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1004/2012] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:17.509913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988003e3-cc62-4096-8bad-154342563c4a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.515889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1009/2013] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:17 2022] POST /identity/v3/users => generated 290 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:17.517649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa982b-8705-4fca-818c-3667aa142744 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.523089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988003e3-cc62-4096-8bad-154342563c4a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.528930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa982b-8705-4fca-818c-3667aa142744 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.534628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cd747-abc3-401e-a0d9-cb3408fe6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.535395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cd747-abc3-401e-a0d9-cb3408fe6b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.536523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54402748-a291-4a45-9b5b-b9e8f7f8258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.536651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cd747-abc3-401e-a0d9-cb3408fe6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.536651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cd747-abc3-401e-a0d9-cb3408fe6b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.536802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54402748-a291-4a45-9b5b-b9e8f7f8258f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.536802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54402748-a291-4a45-9b5b-b9e8f7f8258f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.536929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cd747-abc3-401e-a0d9-cb3408fe6b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.536996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54402748-a291-4a45-9b5b-b9e8f7f8258f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.537868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54402748-a291-4a45-9b5b-b9e8f7f8258f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.538310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cd747-abc3-401e-a0d9-cb3408fe6b89 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.539720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54402748-a291-4a45-9b5b-b9e8f7f8258f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.549659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1005/2014] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:17.554264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cd747-abc3-401e-a0d9-cb3408fe6b89 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.555746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1010/2015] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:17.560779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54402748-a291-4a45-9b5b-b9e8f7f8258f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.566961 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cd747-abc3-401e-a0d9-cb3408fe6b89 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.573034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54402748-a291-4a45-9b5b-b9e8f7f8258f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.573223 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae984e-3946-4bb4-b0cd-b34a993a5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.574123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae984e-3946-4bb4-b0cd-b34a993a5d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.574419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae984e-3946-4bb4-b0cd-b34a993a5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.574684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae984e-3946-4bb4-b0cd-b34a993a5d4e admin admin] PATH_INFO: `/v3/projects/21836130d7da4011bfc677fb54c46fa9/users/b3784c522ef243c7b3db13e453701c48/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.579306 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903abe8-c955-461a-811c-788c3605c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.580475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903abe8-c955-461a-811c-788c3605c05d admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.580837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903abe8-c955-461a-811c-788c3605c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.581252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903abe8-c955-461a-811c-788c3605c05d admin admin] PATH_INFO: `/v3/projects/f55cd0334bab498f90bcf8f595c1d4a3/users/445dec0247674bc9bca25e4c0ec39af1/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.591533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae984e-3946-4bb4-b0cd-b34a993a5d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21836130d7da4011bfc677fb54c46fa9, user_id=b3784c522ef243c7b3db13e453701c48, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.594352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae984e-3946-4bb4-b0cd-b34a993a5d4e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.601746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903abe8-c955-461a-811c-788c3605c05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55cd0334bab498f90bcf8f595c1d4a3, user_id=445dec0247674bc9bca25e4c0ec39af1, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.604644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903abe8-c955-461a-811c-788c3605c05d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.610034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1006/2016] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:17 2022] PUT /identity/v3/projects/21836130d7da4011bfc677fb54c46fa9/users/b3784c522ef243c7b3db13e453701c48/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:17.618010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1011/2017] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:17 2022] PUT /identity/v3/projects/f55cd0334bab498f90bcf8f595c1d4a3/users/445dec0247674bc9bca25e4c0ec39af1/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:17.621733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903abe8-c955-461a-811c-788c3605c05d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.621849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f2d15-b0c1-4721-a9aa-fdcc4a337212 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.622312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f2d15-b0c1-4721-a9aa-fdcc4a337212 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.622394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f2d15-b0c1-4721-a9aa-fdcc4a337212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.650909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-079f2d15-b0c1-4721-a9aa-fdcc4a337212 None None] MFA Rules not processed for user `b3784c522ef243c7b3db13e453701c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:17.652537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-079f2d15-b0c1-4721-a9aa-fdcc4a337212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:17.674872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:17.688729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903abe8-c955-461a-811c-788c3605c05d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.694451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df33677-e200-40b3-b7b2-e8c27f41f999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.695141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df33677-e200-40b3-b7b2-e8c27f41f999 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.695428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df33677-e200-40b3-b7b2-e8c27f41f999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.695709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df33677-e200-40b3-b7b2-e8c27f41f999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.696437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df33677-e200-40b3-b7b2-e8c27f41f999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.698121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df33677-e200-40b3-b7b2-e8c27f41f999 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.709307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1012/2018] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:58:17.713487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df33677-e200-40b3-b7b2-e8c27f41f999 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.723554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1007/2019] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:17.724290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df33677-e200-40b3-b7b2-e8c27f41f999 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.728433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f2d15-b0c1-4721-a9aa-fdcc4a337212 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.729235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ca5b0-1537-46b1-94f2-b0bac4f91af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.730323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ca5b0-1537-46b1-94f2-b0bac4f91af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.730511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ca5b0-1537-46b1-94f2-b0bac4f91af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.730760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ca5b0-1537-46b1-94f2-b0bac4f91af9 admin admin] PATH_INFO: `/v3/projects/f55cd0334bab498f90bcf8f595c1d4a3/users/445dec0247674bc9bca25e4c0ec39af1/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.732877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ca5b0-1537-46b1-94f2-b0bac4f91af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55cd0334bab498f90bcf8f595c1d4a3, user_id=445dec0247674bc9bca25e4c0ec39af1, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.735745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ca5b0-1537-46b1-94f2-b0bac4f91af9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.748591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f2d15-b0c1-4721-a9aa-fdcc4a337212 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.749757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1013/2020] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:17 2022] PUT /identity/v3/projects/f55cd0334bab498f90bcf8f595c1d4a3/users/445dec0247674bc9bca25e4c0ec39af1/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:17.762576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ef946-5aaf-4dc8-83d4-4f3a379dbe0c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.763187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ef946-5aaf-4dc8-83d4-4f3a379dbe0c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.763491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ef946-5aaf-4dc8-83d4-4f3a379dbe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.794039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9b7ef946-5aaf-4dc8-83d4-4f3a379dbe0c None None] MFA Rules not processed for user `445dec0247674bc9bca25e4c0ec39af1`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:17.795218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9b7ef946-5aaf-4dc8-83d4-4f3a379dbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:17.815677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce2b3b-44b8-4474-9f2e-5d13887fac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.816397 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce2b3b-44b8-4474-9f2e-5d13887fac0b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.816690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce2b3b-44b8-4474-9f2e-5d13887fac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.817585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce2b3b-44b8-4474-9f2e-5d13887fac0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.817801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce2b3b-44b8-4474-9f2e-5d13887fac0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.819839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce2b3b-44b8-4474-9f2e-5d13887fac0b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:17.860568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1008/2021] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:17 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:17.862289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce2b3b-44b8-4474-9f2e-5d13887fac0b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.886302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1014/2022] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:17.899485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ef946-5aaf-4dc8-83d4-4f3a379dbe0c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:17.902723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9b7ef946-5aaf-4dc8-83d4-4f3a379dbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:17.923250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:17.983319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce2b3b-44b8-4474-9f2e-5d13887fac0b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:17.989081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a95e8-8951-493b-bc34-33d946cf977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:17.990029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a95e8-8951-493b-bc34-33d946cf977b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:17.990359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a95e8-8951-493b-bc34-33d946cf977b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:17.990689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a95e8-8951-493b-bc34-33d946cf977b admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:17.991504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a95e8-8951-493b-bc34-33d946cf977b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:17.993521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a95e8-8951-493b-bc34-33d946cf977b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:18.013472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ef946-5aaf-4dc8-83d4-4f3a379dbe0c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:18.023802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1009/2023] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:17 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:18.025075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a95e8-8951-493b-bc34-33d946cf977b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:18.030421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f32a95e8-8951-493b-bc34-33d946cf977b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:18.049388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a95e8-8951-493b-bc34-33d946cf977b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:18.054912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:18.055851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.056137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.056415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] PATH_INFO: `/v3/users/552dcf6b62fa49eda7fef73fb5e5671b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.058186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=552dcf6b62fa49eda7fef73fb5e5671b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:18.060362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:18.091064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a88d33-1ebe-4268-bdfe-14ea4e6ce0f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:18.092417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a88d33-1ebe-4268-bdfe-14ea4e6ce0f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.092931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a88d33-1ebe-4268-bdfe-14ea4e6ce0f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.093770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a88d33-1ebe-4268-bdfe-14ea4e6ce0f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.101189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:18.118788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552dcf6b62fa49eda7fef73fb5e5671b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:18.133738 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552dcf6b62fa49eda7fef73fb5e5671b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:18.134512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552dcf6b62fa49eda7fef73fb5e5671b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:18.144640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552dcf6b62fa49eda7fef73fb5e5671b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:18.153171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552dcf6b62fa49eda7fef73fb5e5671b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:18.160014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1010/2024] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:18 2022] DELETE /identity/v3/users/552dcf6b62fa49eda7fef73fb5e5671b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:18.160858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:18.167306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:18.172531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a88d33-1ebe-4268-bdfe-14ea4e6ce0f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:18.174713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a88d33-1ebe-4268-bdfe-14ea4e6ce0f2 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:18.185984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1015/2025] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:18.187334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9274f07-d16b-42c0-9a78-fd3098556805 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.187720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9274f07-d16b-42c0-9a78-fd3098556805 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.188115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9274f07-d16b-42c0-9a78-fd3098556805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.210803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f9274f07-d16b-42c0-9a78-fd3098556805 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:18.212038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f9274f07-d16b-42c0-9a78-fd3098556805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:18.256177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10bea-5f80-47de-9039-d56ccf706ebe admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:18.262264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852e345-76f3-4d2b-a386-7cad1ec5e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:18.262965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852e345-76f3-4d2b-a386-7cad1ec5e898 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.263249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852e345-76f3-4d2b-a386-7cad1ec5e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.263594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852e345-76f3-4d2b-a386-7cad1ec5e898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.264334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852e345-76f3-4d2b-a386-7cad1ec5e898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:18.269846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852e345-76f3-4d2b-a386-7cad1ec5e898 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:18.286355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1011/2026] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:18.289315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852e345-76f3-4d2b-a386-7cad1ec5e898 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:18.292182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b852e345-76f3-4d2b-a386-7cad1ec5e898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:18.313946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1016/2027] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:18.314250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9274f07-d16b-42c0-9a78-fd3098556805 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:18.332604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9274f07-d16b-42c0-9a78-fd3098556805 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:18.338259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7bfd7-433d-4f74-a5f0-b1f32f4a8178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:18.339367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7bfd7-433d-4f74-a5f0-b1f32f4a8178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.339633 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7bfd7-433d-4f74-a5f0-b1f32f4a8178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.339951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7bfd7-433d-4f74-a5f0-b1f32f4a8178 admin admin] PATH_INFO: `/v3/projects/e56302c7202046ecb5ff4ce77ab5cd19/users/771ba3da94b74b8a91d03a8cc5407cf0/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.350738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:18.358617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7bfd7-433d-4f74-a5f0-b1f32f4a8178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56302c7202046ecb5ff4ce77ab5cd19, user_id=771ba3da94b74b8a91d03a8cc5407cf0, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:18.362631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7bfd7-433d-4f74-a5f0-b1f32f4a8178 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:18.372985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852e345-76f3-4d2b-a386-7cad1ec5e898 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:18.382707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1017/2028] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:18 2022] PUT /identity/v3/projects/e56302c7202046ecb5ff4ce77ab5cd19/users/771ba3da94b74b8a91d03a8cc5407cf0/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:18.383989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7bfd7-433d-4f74-a5f0-b1f32f4a8178 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:18.385942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-17e7bfd7-433d-4f74-a5f0-b1f32f4a8178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:18.443090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955c9d-69ea-4f39-bb25-8d553879d929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:18.443760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955c9d-69ea-4f39-bb25-8d553879d929 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.444041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955c9d-69ea-4f39-bb25-8d553879d929 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.444317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955c9d-69ea-4f39-bb25-8d553879d929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.447008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-75955c9d-69ea-4f39-bb25-8d553879d929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:18.457588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7bfd7-433d-4f74-a5f0-b1f32f4a8178 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:18.461535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19652f9-9f1c-4f8b-bc9b-e3e21c5a80fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:18.462325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19652f9-9f1c-4f8b-bc9b-e3e21c5a80fa service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.462679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19652f9-9f1c-4f8b-bc9b-e3e21c5a80fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.463013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19652f9-9f1c-4f8b-bc9b-e3e21c5a80fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.463345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:18.534891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75955c9d-69ea-4f39-bb25-8d553879d929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:18.536493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75955c9d-69ea-4f39-bb25-8d553879d929 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:18.547821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1012/2029] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:18.549181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955c9d-69ea-4f39-bb25-8d553879d929 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:18.576478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19652f9-9f1c-4f8b-bc9b-e3e21c5a80fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:18.578588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19652f9-9f1c-4f8b-bc9b-e3e21c5a80fa service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:18.601852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1018/2030] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:18.640064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955c9d-69ea-4f39-bb25-8d553879d929 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:18.646474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fb89c-c6a8-494a-b4db-74dea542d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:18.647286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb89c-c6a8-494a-b4db-74dea542d475 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.647638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb89c-c6a8-494a-b4db-74dea542d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.647983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fb89c-c6a8-494a-b4db-74dea542d475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.648830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fb89c-c6a8-494a-b4db-74dea542d475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:18.650909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fb89c-c6a8-494a-b4db-74dea542d475 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:18.684286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1013/2031] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:18.691459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19652f9-9f1c-4f8b-bc9b-e3e21c5a80fa service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:18.709018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19652f9-9f1c-4f8b-bc9b-e3e21c5a80fa service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:18.727696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad52f43-4564-4bfd-a580-3dc20e1d91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:18.729203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad52f43-4564-4bfd-a580-3dc20e1d91c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.732317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad52f43-4564-4bfd-a580-3dc20e1d91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.733645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad52f43-4564-4bfd-a580-3dc20e1d91c6 admin admin] PATH_INFO: `/v3/projects/e56302c7202046ecb5ff4ce77ab5cd19/users/771ba3da94b74b8a91d03a8cc5407cf0/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.738818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad52f43-4564-4bfd-a580-3dc20e1d91c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56302c7202046ecb5ff4ce77ab5cd19, user_id=771ba3da94b74b8a91d03a8cc5407cf0, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:18.744766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad52f43-4564-4bfd-a580-3dc20e1d91c6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:18.821491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c003e7-52eb-4681-b77d-79eb5ab27409 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:18.821997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c003e7-52eb-4681-b77d-79eb5ab27409 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:18.822424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c003e7-52eb-4681-b77d-79eb5ab27409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:18.825630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1019/2032] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:18 2022] PUT /identity/v3/projects/e56302c7202046ecb5ff4ce77ab5cd19/users/771ba3da94b74b8a91d03a8cc5407cf0/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:18.879461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d3c003e7-52eb-4681-b77d-79eb5ab27409 None None] MFA Rules not processed for user `771ba3da94b74b8a91d03a8cc5407cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:18.884771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d3c003e7-52eb-4681-b77d-79eb5ab27409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:19.033749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1014/2033] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:19.085506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad52f43-4564-4bfd-a580-3dc20e1d91c6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:19.130299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c003e7-52eb-4681-b77d-79eb5ab27409 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:19.132632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d3c003e7-52eb-4681-b77d-79eb5ab27409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:19.198162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad52f43-4564-4bfd-a580-3dc20e1d91c6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:19.203894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f32ff7-7f4b-4cf3-8a72-c09c0f6a0326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:19.205783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f32ff7-7f4b-4cf3-8a72-c09c0f6a0326 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.206069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f32ff7-7f4b-4cf3-8a72-c09c0f6a0326 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.206393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f32ff7-7f4b-4cf3-8a72-c09c0f6a0326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.217407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:19.218697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f32ff7-7f4b-4cf3-8a72-c09c0f6a0326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:19.221190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f32ff7-7f4b-4cf3-8a72-c09c0f6a0326 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:19.237264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1020/2034] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:58:19.275867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c003e7-52eb-4681-b77d-79eb5ab27409 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:19.284545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:19.285467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.285813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.286134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] PATH_INFO: `/v3/projects/b520049159af47d182c8500e9b80b280` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.287536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b520049159af47d182c8500e9b80b280)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:19.300787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:19.373762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f32ff7-7f4b-4cf3-8a72-c09c0f6a0326 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:19.387303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f32ff7-7f4b-4cf3-8a72-c09c0f6a0326 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:19.400971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b520049159af47d182c8500e9b80b280', 'request_id': 'req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:19.407450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b520049159af47d182c8500e9b80b280', 'request_id': 'req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:19.415047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b520049159af47d182c8500e9b80b280', 'request_id': 'req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:19.429039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:19.435408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] The token cache is being invalidate because project b520049159af47d182c8500e9b80b280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:19.435696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:19.436513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f7afe10d-6f40-41af-a7c2-26b4fb1cefa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:19.438759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1015/2035] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:19 2022] DELETE /identity/v3/projects/b520049159af47d182c8500e9b80b280 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:19.443664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b0c92-98fb-4920-8f8d-6245a7c463b7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.443940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b0c92-98fb-4920-8f8d-6245a7c463b7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.444216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b0c92-98fb-4920-8f8d-6245a7c463b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.467475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8d1b0c92-98fb-4920-8f8d-6245a7c463b7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:19.468758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8d1b0c92-98fb-4920-8f8d-6245a7c463b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:19.472431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0d426-caf9-40c9-98ab-19ce53e905bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:19.473327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0d426-caf9-40c9-98ab-19ce53e905bb service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.473620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0d426-caf9-40c9-98ab-19ce53e905bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.474116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0d426-caf9-40c9-98ab-19ce53e905bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.476580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-39c0d426-caf9-40c9-98ab-19ce53e905bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:19.545687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0d426-caf9-40c9-98ab-19ce53e905bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:19.547249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0d426-caf9-40c9-98ab-19ce53e905bb service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:19.548571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1016/2036] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:19.557777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de76bf4-9b9d-49b6-bbc2-a1ed6ddab1fa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.558126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de76bf4-9b9d-49b6-bbc2-a1ed6ddab1fa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.558412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1021/2037] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:19.558509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de76bf4-9b9d-49b6-bbc2-a1ed6ddab1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.580892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4de76bf4-9b9d-49b6-bbc2-a1ed6ddab1fa None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:19.582199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4de76bf4-9b9d-49b6-bbc2-a1ed6ddab1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:19.590765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1017/2038] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:19.595832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0d426-caf9-40c9-98ab-19ce53e905bb service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:19.609520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0d426-caf9-40c9-98ab-19ce53e905bb service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:19.616165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9850e87-b4f8-4e27-a351-d60ee1184d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:19.617059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9850e87-b4f8-4e27-a351-d60ee1184d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.617385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9850e87-b4f8-4e27-a351-d60ee1184d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.617665 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9850e87-b4f8-4e27-a351-d60ee1184d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.618558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9850e87-b4f8-4e27-a351-d60ee1184d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:19.618868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9850e87-b4f8-4e27-a351-d60ee1184d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:19.621141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9850e87-b4f8-4e27-a351-d60ee1184d80 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:19.636944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1022/2039] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:58:19.641088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de76bf4-9b9d-49b6-bbc2-a1ed6ddab1fa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:19.652233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de76bf4-9b9d-49b6-bbc2-a1ed6ddab1fa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:19.657371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3b64-5491-41f1-9596-539c65abe502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:19.658876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3b64-5491-41f1-9596-539c65abe502 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.659176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3b64-5491-41f1-9596-539c65abe502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.659444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3b64-5491-41f1-9596-539c65abe502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.660179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb3b64-5491-41f1-9596-539c65abe502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:19.662203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb3b64-5491-41f1-9596-539c65abe502 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:19.695347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1018/2040] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:19 2022] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:19.699712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9850e87-b4f8-4e27-a351-d60ee1184d80 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:19.711156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9850e87-b4f8-4e27-a351-d60ee1184d80 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:19.778847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aac28-56cf-4b76-8b26-6e93f87f6dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:19.779098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aac28-56cf-4b76-8b26-6e93f87f6dac admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.779616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aac28-56cf-4b76-8b26-6e93f87f6dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.779797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aac28-56cf-4b76-8b26-6e93f87f6dac admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.780727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aac28-56cf-4b76-8b26-6e93f87f6dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:19.783414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aac28-56cf-4b76-8b26-6e93f87f6dac admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:19.809443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1023/2041] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:19 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:19.811492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3b64-5491-41f1-9596-539c65abe502 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:19.822928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3b64-5491-41f1-9596-539c65abe502 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:19.831124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f68e8-0afa-4f61-8484-13f8cf82a1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:19.832207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f68e8-0afa-4f61-8484-13f8cf82a1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.833598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f68e8-0afa-4f61-8484-13f8cf82a1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.834155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f68e8-0afa-4f61-8484-13f8cf82a1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.834928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f68e8-0afa-4f61-8484-13f8cf82a1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:19.837836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f68e8-0afa-4f61-8484-13f8cf82a1ef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:19.854640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1019/2042] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:19.855731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aac28-56cf-4b76-8b26-6e93f87f6dac admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:19.868278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aac28-56cf-4b76-8b26-6e93f87f6dac admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:19.880575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430ddc-422c-4251-bd3e-85f6d7baa7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:19.881381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430ddc-422c-4251-bd3e-85f6d7baa7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.881688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430ddc-422c-4251-bd3e-85f6d7baa7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.881968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430ddc-422c-4251-bd3e-85f6d7baa7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.883526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3430ddc-422c-4251-bd3e-85f6d7baa7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:19.886046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3430ddc-422c-4251-bd3e-85f6d7baa7f0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:19.902178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1024/2043] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:58:19.906999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f68e8-0afa-4f61-8484-13f8cf82a1ef admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:19.922568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f68e8-0afa-4f61-8484-13f8cf82a1ef admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:19.928013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e501fd-4972-41ec-b259-8b511753a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:19.928973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e501fd-4972-41ec-b259-8b511753a98a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.929333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e501fd-4972-41ec-b259-8b511753a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.929620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e501fd-4972-41ec-b259-8b511753a98a admin admin] PATH_INFO: `/v3/projects/44ae48454e604ef1a9cbe0df12c1d978/users/2f9474ef84414a50bb76bcc1435863a2/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:19.948278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e501fd-4972-41ec-b259-8b511753a98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ae48454e604ef1a9cbe0df12c1d978, user_id=2f9474ef84414a50bb76bcc1435863a2, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:19.951395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e501fd-4972-41ec-b259-8b511753a98a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:19.970629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1020/2044] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:19 2022] PUT /identity/v3/projects/44ae48454e604ef1a9cbe0df12c1d978/users/2f9474ef84414a50bb76bcc1435863a2/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:19.983232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d5dd8-19cd-4e4a-a532-4e99d6dbbb4f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:19.983232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d5dd8-19cd-4e4a-a532-4e99d6dbbb4f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:19.983232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d5dd8-19cd-4e4a-a532-4e99d6dbbb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:20.015039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f55d5dd8-19cd-4e4a-a532-4e99d6dbbb4f None None] MFA Rules not processed for user `2f9474ef84414a50bb76bcc1435863a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:20.016323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f55d5dd8-19cd-4e4a-a532-4e99d6dbbb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:20.069306 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:20.118548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1025/2045] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:20.140070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e501fd-4972-41ec-b259-8b511753a98a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:20.143091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-23e501fd-4972-41ec-b259-8b511753a98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:20.159983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:20.257210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e501fd-4972-41ec-b259-8b511753a98a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:20.264393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f737200-ebca-45ed-abd2-b3c6b93fc67f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:20.265695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737200-ebca-45ed-abd2-b3c6b93fc67f service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:20.266878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737200-ebca-45ed-abd2-b3c6b93fc67f service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:20.268474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737200-ebca-45ed-abd2-b3c6b93fc67f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:20.286989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737200-ebca-45ed-abd2-b3c6b93fc67f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:20.289577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737200-ebca-45ed-abd2-b3c6b93fc67f service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:20.303166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1021/2046] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:20.606583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d5dd8-19cd-4e4a-a532-4e99d6dbbb4f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:20.609680 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f55d5dd8-19cd-4e4a-a532-4e99d6dbbb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:20.707231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d5dd8-19cd-4e4a-a532-4e99d6dbbb4f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:20.712518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:20.713508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:20.713792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:20.714287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] PATH_INFO: `/v3/users/701cb7d5036240eb94d534fa5b1b00ff` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:20.715634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=701cb7d5036240eb94d534fa5b1b00ff)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:20.717642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:20.801939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '701cb7d5036240eb94d534fa5b1b00ff'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:20.804534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '701cb7d5036240eb94d534fa5b1b00ff'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:20.805900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '701cb7d5036240eb94d534fa5b1b00ff'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:20.825165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '701cb7d5036240eb94d534fa5b1b00ff'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:20.843640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '701cb7d5036240eb94d534fa5b1b00ff'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:20.879183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1026/2047] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:20 2022] DELETE /identity/v3/users/701cb7d5036240eb94d534fa5b1b00ff => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:20.884173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019579-0e0d-40bc-acb0-e3fc4199a157 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:20.884651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019579-0e0d-40bc-acb0-e3fc4199a157 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:20.884875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019579-0e0d-40bc-acb0-e3fc4199a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:20.904394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f6019579-0e0d-40bc-acb0-e3fc4199a157 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:20.905592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f6019579-0e0d-40bc-acb0-e3fc4199a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:20.977211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1022/2048] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:20.988995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:20.991088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:21.078199 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209d14f-37c8-4a33-81ce-a742a686e68f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:21.082933 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f9c35-320f-40df-b5a7-cf7a61bb3484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:21.083623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f9c35-320f-40df-b5a7-cf7a61bb3484 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:21.083907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f9c35-320f-40df-b5a7-cf7a61bb3484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:21.084182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f9c35-320f-40df-b5a7-cf7a61bb3484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:21.096295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f9c35-320f-40df-b5a7-cf7a61bb3484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:21.097059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f9c35-320f-40df-b5a7-cf7a61bb3484 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:21.103435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:21.123066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1027/2049] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:21.577269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6019579-0e0d-40bc-acb0-e3fc4199a157 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:21.578967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f6019579-0e0d-40bc-acb0-e3fc4199a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:21.592711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6019579-0e0d-40bc-acb0-e3fc4199a157 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:21.598707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:21.599625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:21.599908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:21.600185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] PATH_INFO: `/v3/projects/1da47e58500145d180826fb988ca8cda` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:21.601631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da47e58500145d180826fb988ca8cda)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:21.603737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:21.662546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da47e58500145d180826fb988ca8cda', 'request_id': 'req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.670755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da47e58500145d180826fb988ca8cda', 'request_id': 'req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.679791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da47e58500145d180826fb988ca8cda', 'request_id': 'req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.697503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] The token cache is being invalidate because project 1da47e58500145d180826fb988ca8cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:21.698000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.699105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.700817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1023/2050] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:21 2022] DELETE /identity/v3/projects/1da47e58500145d180826fb988ca8cda => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:21.705636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f9c35-320f-40df-b5a7-cf7a61bb3484 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:21.715982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f9c35-320f-40df-b5a7-cf7a61bb3484 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:21.787186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:21.788169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:21.788509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:21.788876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] PATH_INFO: `/v3/users/1ac4dcfa7df947219bebd52e748e8cf3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:21.790321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac4dcfa7df947219bebd52e748e8cf3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:21.792423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:21.870670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac4dcfa7df947219bebd52e748e8cf3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.871470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac4dcfa7df947219bebd52e748e8cf3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.872190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac4dcfa7df947219bebd52e748e8cf3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.885815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac4dcfa7df947219bebd52e748e8cf3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.900742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac4dcfa7df947219bebd52e748e8cf3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:21.925783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1028/2051] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:21 2022] DELETE /identity/v3/users/1ac4dcfa7df947219bebd52e748e8cf3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:22.508351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:22.513865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:22.567149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb380c7-6743-4d44-9af6-3f9cfe6f3287 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:22.583738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:22.585471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:22.625986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:22.677378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:22.678976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:22.678976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:22.679185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] PATH_INFO: `/v3/projects/b009dcf19b634148bb874b9b7572b5b6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:22.681425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b009dcf19b634148bb874b9b7572b5b6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:22.684965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:22.779146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b009dcf19b634148bb874b9b7572b5b6', 'request_id': 'req-3e2d624d-948a-4f09-98c2-22012a3eb97f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:22.784181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa6854-5c55-49b4-973b-af0feff25497 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:22.791598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b009dcf19b634148bb874b9b7572b5b6', 'request_id': 'req-3e2d624d-948a-4f09-98c2-22012a3eb97f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:22.801747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b009dcf19b634148bb874b9b7572b5b6', 'request_id': 'req-3e2d624d-948a-4f09-98c2-22012a3eb97f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:22.823598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] The token cache is being invalidate because project b009dcf19b634148bb874b9b7572b5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:22.824090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:22.824934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:22.830497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1024/2052] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:22 2022] DELETE /identity/v3/projects/b009dcf19b634148bb874b9b7572b5b6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:22.835890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:22.837615 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:22.841710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:22.971586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:22.975389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:22.978254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:22.978683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] PATH_INFO: `/v3/users/b3784c522ef243c7b3db13e453701c48` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:22.982914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3784c522ef243c7b3db13e453701c48)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:22.991107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:23.009642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d624d-948a-4f09-98c2-22012a3eb97f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:23.016726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:23.017702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:23.018063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:23.018394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] PATH_INFO: `/v3/users/8e27cde4a82c4203a9527ae2c80a11c8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:23.019877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e27cde4a82c4203a9527ae2c80a11c8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:23.022176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:23.107922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e27cde4a82c4203a9527ae2c80a11c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.116922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3784c522ef243c7b3db13e453701c48'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.117742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3784c522ef243c7b3db13e453701c48'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.118820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3784c522ef243c7b3db13e453701c48'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.132823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:23.134731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e27cde4a82c4203a9527ae2c80a11c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.136136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e27cde4a82c4203a9527ae2c80a11c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.154387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3784c522ef243c7b3db13e453701c48'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.162559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e27cde4a82c4203a9527ae2c80a11c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.173245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ae6163bb-898c-4e9f-a7d4-52dbc4bd8a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e27cde4a82c4203a9527ae2c80a11c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.181432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3784c522ef243c7b3db13e453701c48'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.186469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1025/2053] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:22 2022] DELETE /identity/v3/users/8e27cde4a82c4203a9527ae2c80a11c8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:23.230522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1029/2054] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:22 2022] DELETE /identity/v3/users/b3784c522ef243c7b3db13e453701c48 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:23.238842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6e084-4a45-46d2-8fa6-70bcbd48bef1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:23.242029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6e084-4a45-46d2-8fa6-70bcbd48bef1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:23.242438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6e084-4a45-46d2-8fa6-70bcbd48bef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:23.275699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cca6e084-4a45-46d2-8fa6-70bcbd48bef1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:23.277978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cca6e084-4a45-46d2-8fa6-70bcbd48bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:23.374885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1026/2055] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:23.392453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:23.394444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:23.495495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c507944-b88a-4aa4-a969-ffbcdb04251b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:23.503287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592731d6-3f0a-426d-b628-ec6eed369a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:23.504373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592731d6-3f0a-426d-b628-ec6eed369a4d service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:23.504764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592731d6-3f0a-426d-b628-ec6eed369a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:23.505213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592731d6-3f0a-426d-b628-ec6eed369a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:23.518556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592731d6-3f0a-426d-b628-ec6eed369a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:23.521674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592731d6-3f0a-426d-b628-ec6eed369a4d service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:23.541091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1030/2056] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:23.594588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6e084-4a45-46d2-8fa6-70bcbd48bef1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:23.596302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cca6e084-4a45-46d2-8fa6-70bcbd48bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:23.615389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6e084-4a45-46d2-8fa6-70bcbd48bef1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:23.620694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:23.621638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:23.621925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:23.622480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] PATH_INFO: `/v3/projects/4ee742b72adf471fb8bf47cd39cc32ee` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:23.623852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee742b72adf471fb8bf47cd39cc32ee)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:23.627349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:23.700207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee742b72adf471fb8bf47cd39cc32ee', 'request_id': 'req-9f88b1e8-da9a-43ae-9e41-6a59b8632103'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.712886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee742b72adf471fb8bf47cd39cc32ee', 'request_id': 'req-9f88b1e8-da9a-43ae-9e41-6a59b8632103'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.722068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee742b72adf471fb8bf47cd39cc32ee', 'request_id': 'req-9f88b1e8-da9a-43ae-9e41-6a59b8632103'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.741560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] The token cache is being invalidate because project 4ee742b72adf471fb8bf47cd39cc32ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:23.741995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.742734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f88b1e8-da9a-43ae-9e41-6a59b8632103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:23.744385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1027/2057] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:23 2022] DELETE /identity/v3/projects/4ee742b72adf471fb8bf47cd39cc32ee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:23.751123 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b661-6694-4b1e-b6ca-723432572a2b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:23.751443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b661-6694-4b1e-b6ca-723432572a2b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:23.751572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b661-6694-4b1e-b6ca-723432572a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:23.772460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bf66b661-6694-4b1e-b6ca-723432572a2b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:23.774034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bf66b661-6694-4b1e-b6ca-723432572a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:23.852015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:23.888167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1031/2058] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:23.896466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51375a33-f98e-4316-8a38-1a170585d11d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:23.896950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51375a33-f98e-4316-8a38-1a170585d11d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:23.897562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51375a33-f98e-4316-8a38-1a170585d11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:23.931180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-51375a33-f98e-4316-8a38-1a170585d11d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:23.932922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-51375a33-f98e-4316-8a38-1a170585d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:23.942690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1028/2059] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:23.947992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b661-6694-4b1e-b6ca-723432572a2b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:23.968472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b661-6694-4b1e-b6ca-723432572a2b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:23.975564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770419b-f93b-4497-9ed5-469459e7945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:23.976360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770419b-f93b-4497-9ed5-469459e7945e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:23.976530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770419b-f93b-4497-9ed5-469459e7945e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:23.976804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770419b-f93b-4497-9ed5-469459e7945e admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:23.978507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770419b-f93b-4497-9ed5-469459e7945e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:23.978507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770419b-f93b-4497-9ed5-469459e7945e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:23.979855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770419b-f93b-4497-9ed5-469459e7945e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:24.006136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1032/2060] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:58:24.009187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51375a33-f98e-4316-8a38-1a170585d11d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:24.021637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51375a33-f98e-4316-8a38-1a170585d11d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:24.031566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e966e4-c176-49cd-9878-1344b04996a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:24.032981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e966e4-c176-49cd-9878-1344b04996a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:24.033399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e966e4-c176-49cd-9878-1344b04996a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:24.033790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e966e4-c176-49cd-9878-1344b04996a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:24.035134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e966e4-c176-49cd-9878-1344b04996a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:24.039469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e966e4-c176-49cd-9878-1344b04996a8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:24.072026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1029/2061] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:24 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:24.077513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770419b-f93b-4497-9ed5-469459e7945e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:24.091640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770419b-f93b-4497-9ed5-469459e7945e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:24.126691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e966e4-c176-49cd-9878-1344b04996a8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:24.128442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-60e966e4-c176-49cd-9878-1344b04996a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:24.204389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:24.225756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3155e-7d21-40cb-ae45-52bb3ab333b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:24.226736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3155e-7d21-40cb-ae45-52bb3ab333b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:24.227097 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3155e-7d21-40cb-ae45-52bb3ab333b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:24.227371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3155e-7d21-40cb-ae45-52bb3ab333b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:24.229065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3155e-7d21-40cb-ae45-52bb3ab333b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:24.233223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3155e-7d21-40cb-ae45-52bb3ab333b9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:24.262732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1033/2062] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:24 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:24.266386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e966e4-c176-49cd-9878-1344b04996a8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:24.266986 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3155e-7d21-40cb-ae45-52bb3ab333b9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:24.271920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:24.272853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:24.273142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:24.273461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] PATH_INFO: `/v3/projects/21836130d7da4011bfc677fb54c46fa9` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:24.274761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21836130d7da4011bfc677fb54c46fa9)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:24.276767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:24.281157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3155e-7d21-40cb-ae45-52bb3ab333b9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:24.288180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b145f-e115-4c83-8b67-3c98e2897803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:24.288898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b145f-e115-4c83-8b67-3c98e2897803 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:24.289409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b145f-e115-4c83-8b67-3c98e2897803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:24.289701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b145f-e115-4c83-8b67-3c98e2897803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:24.291533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b145f-e115-4c83-8b67-3c98e2897803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:24.292254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b145f-e115-4c83-8b67-3c98e2897803 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:24.325472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1034/2063] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:58:24.327006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b145f-e115-4c83-8b67-3c98e2897803 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:24.342619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b145f-e115-4c83-8b67-3c98e2897803 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:24.348505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21836130d7da4011bfc677fb54c46fa9', 'request_id': 'req-02ba83a4-7c60-49a0-ae3a-c326cead9365'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.359947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21836130d7da4011bfc677fb54c46fa9', 'request_id': 'req-02ba83a4-7c60-49a0-ae3a-c326cead9365'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.369957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21836130d7da4011bfc677fb54c46fa9', 'request_id': 'req-02ba83a4-7c60-49a0-ae3a-c326cead9365'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.415123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] The token cache is being invalidate because project 21836130d7da4011bfc677fb54c46fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:24.416424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.417606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.420425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1030/2064] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:24 2022] DELETE /identity/v3/projects/21836130d7da4011bfc677fb54c46fa9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:24.425161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:24.433186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:24.448009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef22ce1-8762-4252-afe5-c1e307fd2488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:24.448902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef22ce1-8762-4252-afe5-c1e307fd2488 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:24.449266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef22ce1-8762-4252-afe5-c1e307fd2488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:24.449611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef22ce1-8762-4252-afe5-c1e307fd2488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:24.450504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef22ce1-8762-4252-afe5-c1e307fd2488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:24.459200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef22ce1-8762-4252-afe5-c1e307fd2488 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:24.476055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1035/2065] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:24.484832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef22ce1-8762-4252-afe5-c1e307fd2488 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:24.484961 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba83a4-7c60-49a0-ae3a-c326cead9365 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:24.486877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5ef22ce1-8762-4252-afe5-c1e307fd2488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:24.494695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:24.498947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:24.499258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:24.499838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] PATH_INFO: `/v3/users/771ba3da94b74b8a91d03a8cc5407cf0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:24.502198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef22ce1-8762-4252-afe5-c1e307fd2488 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:24.507543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24197dbb-7ad8-49e7-abc0-b43df6d32764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:24.508089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=771ba3da94b74b8a91d03a8cc5407cf0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:24.508627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24197dbb-7ad8-49e7-abc0-b43df6d32764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:24.508977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24197dbb-7ad8-49e7-abc0-b43df6d32764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:24.509351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24197dbb-7ad8-49e7-abc0-b43df6d32764 admin admin] PATH_INFO: `/v3/projects/d38fe034c4c24983a928840dd12c3c75/users/81ec46005396450f919bfb7dd85c42c5/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:24.514481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:24.539295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24197dbb-7ad8-49e7-abc0-b43df6d32764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38fe034c4c24983a928840dd12c3c75, user_id=81ec46005396450f919bfb7dd85c42c5, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:24.545003 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24197dbb-7ad8-49e7-abc0-b43df6d32764 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:24.571213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1036/2066] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:24 2022] PUT /identity/v3/projects/d38fe034c4c24983a928840dd12c3c75/users/81ec46005396450f919bfb7dd85c42c5/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:24.582357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f20c0d-ccd1-4ab9-ac45-eabcb96c136a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:24.582766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f20c0d-ccd1-4ab9-ac45-eabcb96c136a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:24.583046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f20c0d-ccd1-4ab9-ac45-eabcb96c136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:24.589233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771ba3da94b74b8a91d03a8cc5407cf0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.610636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771ba3da94b74b8a91d03a8cc5407cf0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.611946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771ba3da94b74b8a91d03a8cc5407cf0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.620890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c3f20c0d-ccd1-4ab9-ac45-eabcb96c136a None None] MFA Rules not processed for user `81ec46005396450f919bfb7dd85c42c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:24.623277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c3f20c0d-ccd1-4ab9-ac45-eabcb96c136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:24.627724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771ba3da94b74b8a91d03a8cc5407cf0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.644517 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771ba3da94b74b8a91d03a8cc5407cf0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:24.649979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:24.656860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1031/2067] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:24 2022] DELETE /identity/v3/users/771ba3da94b74b8a91d03a8cc5407cf0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:24.783914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1037/2068] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:24.788913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:24.790450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:24.839984 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:24.868475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f0fa4-ea31-484b-9a6f-3a2c3176ad4a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:24.874136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4ba3b-319b-47ad-9b2b-86c53f2ec9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:24.875348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4ba3b-319b-47ad-9b2b-86c53f2ec9ce admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:24.875633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4ba3b-319b-47ad-9b2b-86c53f2ec9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:24.875912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4ba3b-319b-47ad-9b2b-86c53f2ec9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:24.877582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4ba3b-319b-47ad-9b2b-86c53f2ec9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:24.879060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4ba3b-319b-47ad-9b2b-86c53f2ec9ce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:24.927646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1032/2069] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:24 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:24.930931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f20c0d-ccd1-4ab9-ac45-eabcb96c136a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.027639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f20c0d-ccd1-4ab9-ac45-eabcb96c136a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.109431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada779-346a-420f-8835-a715381a4b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.111030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada779-346a-420f-8835-a715381a4b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.111847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada779-346a-420f-8835-a715381a4b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.111988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada779-346a-420f-8835-a715381a4b65 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.113529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ada779-346a-420f-8835-a715381a4b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.118651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ada779-346a-420f-8835-a715381a4b65 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.145510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4ba3b-319b-47ad-9b2b-86c53f2ec9ce admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.151016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8fd4ba3b-319b-47ad-9b2b-86c53f2ec9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:25.163485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1038/2070] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:24 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:25.167772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada779-346a-420f-8835-a715381a4b65 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.185664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada779-346a-420f-8835-a715381a4b65 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.187929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4ba3b-319b-47ad-9b2b-86c53f2ec9ce admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.192567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca640-01b1-4e70-a2df-5f1f377ed64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.193283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca640-01b1-4e70-a2df-5f1f377ed64f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.193567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca640-01b1-4e70-a2df-5f1f377ed64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.193846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca640-01b1-4e70-a2df-5f1f377ed64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.194722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dca640-01b1-4e70-a2df-5f1f377ed64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.196496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dca640-01b1-4e70-a2df-5f1f377ed64f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.210987 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1039/2071] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:25.213716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.215179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca640-01b1-4e70-a2df-5f1f377ed64f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.215480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.215920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.216439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] PATH_INFO: `/v3/projects/e56302c7202046ecb5ff4ce77ab5cd19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.219647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56302c7202046ecb5ff4ce77ab5cd19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.223712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.226783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca640-01b1-4e70-a2df-5f1f377ed64f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.231882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608aa87-2c3b-45ef-bab4-fb421be0ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.232695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608aa87-2c3b-45ef-bab4-fb421be0ac8b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.233047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608aa87-2c3b-45ef-bab4-fb421be0ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.233393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608aa87-2c3b-45ef-bab4-fb421be0ac8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.234300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608aa87-2c3b-45ef-bab4-fb421be0ac8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.236876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608aa87-2c3b-45ef-bab4-fb421be0ac8b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.257178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1040/2072] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:25.258270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608aa87-2c3b-45ef-bab4-fb421be0ac8b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.271303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608aa87-2c3b-45ef-bab4-fb421be0ac8b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.277736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef49b3-b09f-4d0b-aa4f-5077726dbe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.280061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef49b3-b09f-4d0b-aa4f-5077726dbe3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.280396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef49b3-b09f-4d0b-aa4f-5077726dbe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.280737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef49b3-b09f-4d0b-aa4f-5077726dbe3f admin admin] PATH_INFO: `/v3/projects/15b5584a3b9a4691aa1a2a7374f82e65/users/55fd2bb2ab074294b45edad8a7f6a39c/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.300116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef49b3-b09f-4d0b-aa4f-5077726dbe3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b5584a3b9a4691aa1a2a7374f82e65, user_id=55fd2bb2ab074294b45edad8a7f6a39c, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.303183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef49b3-b09f-4d0b-aa4f-5077726dbe3f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.322395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56302c7202046ecb5ff4ce77ab5cd19', 'request_id': 'req-94b09039-7926-4505-9f9f-e5bc656fab7a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:25.334596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56302c7202046ecb5ff4ce77ab5cd19', 'request_id': 'req-94b09039-7926-4505-9f9f-e5bc656fab7a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:25.336403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1041/2073] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:25 2022] PUT /identity/v3/projects/15b5584a3b9a4691aa1a2a7374f82e65/users/55fd2bb2ab074294b45edad8a7f6a39c/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:25.345298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56302c7202046ecb5ff4ce77ab5cd19', 'request_id': 'req-94b09039-7926-4505-9f9f-e5bc656fab7a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:25.357681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8494f24-64a6-4eaf-984a-c39708dc10f3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.358307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8494f24-64a6-4eaf-984a-c39708dc10f3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.358736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8494f24-64a6-4eaf-984a-c39708dc10f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.370591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] The token cache is being invalidate because project e56302c7202046ecb5ff4ce77ab5cd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:25.370941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:25.371572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:25.372249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-94b09039-7926-4505-9f9f-e5bc656fab7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:25.375573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1033/2074] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:25 2022] DELETE /identity/v3/projects/e56302c7202046ecb5ff4ce77ab5cd19 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:25.383004 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5f72e-ba50-4618-8ac0-e7169d299c92 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.383652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5f72e-ba50-4618-8ac0-e7169d299c92 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.384252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5f72e-ba50-4618-8ac0-e7169d299c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.423014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f7f5f72e-ba50-4618-8ac0-e7169d299c92 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:25.424212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e8494f24-64a6-4eaf-984a-c39708dc10f3 None None] MFA Rules not processed for user `55fd2bb2ab074294b45edad8a7f6a39c`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:25.425486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e8494f24-64a6-4eaf-984a-c39708dc10f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:25.425883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f7f5f72e-ba50-4618-8ac0-e7169d299c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:25.581902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1034/2075] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:25.595241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f4828-db9b-4d12-9a59-04b0990726dc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.596599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f4828-db9b-4d12-9a59-04b0990726dc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.596599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f4828-db9b-4d12-9a59-04b0990726dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.608296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1042/2076] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:25.615170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8494f24-64a6-4eaf-984a-c39708dc10f3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.617491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e8494f24-64a6-4eaf-984a-c39708dc10f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:25.628373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-009f4828-db9b-4d12-9a59-04b0990726dc None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:25.631005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-009f4828-db9b-4d12-9a59-04b0990726dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:25.642234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8494f24-64a6-4eaf-984a-c39708dc10f3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.644746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1035/2077] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:25.649459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f4828-db9b-4d12-9a59-04b0990726dc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.652769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987499b-20d1-4e4b-887d-f0047f1df4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.653569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987499b-20d1-4e4b-887d-f0047f1df4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.653926 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987499b-20d1-4e4b-887d-f0047f1df4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.654374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987499b-20d1-4e4b-887d-f0047f1df4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.655110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987499b-20d1-4e4b-887d-f0047f1df4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.657241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987499b-20d1-4e4b-887d-f0047f1df4a7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.664388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f4828-db9b-4d12-9a59-04b0990726dc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.671380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f92ce-e1da-4374-813f-73db82e0245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.672392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f92ce-e1da-4374-813f-73db82e0245d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.673029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f92ce-e1da-4374-813f-73db82e0245d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.673447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f92ce-e1da-4374-813f-73db82e0245d admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.674399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f92ce-e1da-4374-813f-73db82e0245d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:25.675662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f92ce-e1da-4374-813f-73db82e0245d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.678742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f92ce-e1da-4374-813f-73db82e0245d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.694174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1043/2078] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:25 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:25.695197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987499b-20d1-4e4b-887d-f0047f1df4a7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.701985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1036/2079] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:58:25.706282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f92ce-e1da-4374-813f-73db82e0245d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.723933 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f92ce-e1da-4374-813f-73db82e0245d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.777634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:25.818213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987499b-20d1-4e4b-887d-f0047f1df4a7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.831824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d77461-21d7-4f20-841b-cedf44043a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.832642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d77461-21d7-4f20-841b-cedf44043a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.832934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d77461-21d7-4f20-841b-cedf44043a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.833217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d77461-21d7-4f20-841b-cedf44043a6f admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.834503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d77461-21d7-4f20-841b-cedf44043a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.836070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d77461-21d7-4f20-841b-cedf44043a6f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.857240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452ab2-6f51-43d0-9608-3605b920b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.858527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452ab2-6f51-43d0-9608-3605b920b929 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.859007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452ab2-6f51-43d0-9608-3605b920b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.859569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452ab2-6f51-43d0-9608-3605b920b929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.861061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452ab2-6f51-43d0-9608-3605b920b929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.862230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1044/2080] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:25 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:25.864830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452ab2-6f51-43d0-9608-3605b920b929 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.866610 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d77461-21d7-4f20-841b-cedf44043a6f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.878727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d77461-21d7-4f20-841b-cedf44043a6f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:25.885040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f7108-5dd5-4689-956c-8b87059c1c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:25.885904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f7108-5dd5-4689-956c-8b87059c1c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:25.886241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f7108-5dd5-4689-956c-8b87059c1c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:25.886577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f7108-5dd5-4689-956c-8b87059c1c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:25.887337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f7108-5dd5-4689-956c-8b87059c1c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:25.889054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f7108-5dd5-4689-956c-8b87059c1c68 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:25.911491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1037/2081] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:25 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:25.913408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1045/2082] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:58:25.917792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452ab2-6f51-43d0-9608-3605b920b929 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.921920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f7108-5dd5-4689-956c-8b87059c1c68 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:25.945783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f7108-5dd5-4689-956c-8b87059c1c68 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:26.014171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452ab2-6f51-43d0-9608-3605b920b929 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:26.024861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f97134-4aa5-4f9b-8cb4-eef0ac9ae2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:26.026592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f97134-4aa5-4f9b-8cb4-eef0ac9ae2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.026882 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f97134-4aa5-4f9b-8cb4-eef0ac9ae2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.030217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f97134-4aa5-4f9b-8cb4-eef0ac9ae2dd admin admin] PATH_INFO: `/v3/projects/8e953230e5b8435181d6c627c96231bd/users/dbbd1f0181064a39bc44c9b9c5d1742c/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.055260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f97134-4aa5-4f9b-8cb4-eef0ac9ae2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e953230e5b8435181d6c627c96231bd, user_id=dbbd1f0181064a39bc44c9b9c5d1742c, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:26.056473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:26.060489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f97134-4aa5-4f9b-8cb4-eef0ac9ae2dd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:26.080502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cf911-d739-4dd8-a16b-2786ce34a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:26.081843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cf911-d739-4dd8-a16b-2786ce34a358 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.082729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cf911-d739-4dd8-a16b-2786ce34a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.083356 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cf911-d739-4dd8-a16b-2786ce34a358 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.084789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cf911-d739-4dd8-a16b-2786ce34a358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:26.088675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1038/2083] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:25 2022] PUT /identity/v3/projects/8e953230e5b8435181d6c627c96231bd/users/dbbd1f0181064a39bc44c9b9c5d1742c/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:26.089628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cf911-d739-4dd8-a16b-2786ce34a358 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:26.090029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f97134-4aa5-4f9b-8cb4-eef0ac9ae2dd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:26.142891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1046/2084] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:25 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:26.147315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cf911-d739-4dd8-a16b-2786ce34a358 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:26.160473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cf911-d739-4dd8-a16b-2786ce34a358 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:26.172778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f97134-4aa5-4f9b-8cb4-eef0ac9ae2dd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:26.181782 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57fbca-0fd2-4fe1-82c5-bf148bec49bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:26.182912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57fbca-0fd2-4fe1-82c5-bf148bec49bd admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.183362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57fbca-0fd2-4fe1-82c5-bf148bec49bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.183817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57fbca-0fd2-4fe1-82c5-bf148bec49bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.185152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57fbca-0fd2-4fe1-82c5-bf148bec49bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:26.190145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57fbca-0fd2-4fe1-82c5-bf148bec49bd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:26.211781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1039/2085] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:26.213913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57fbca-0fd2-4fe1-82c5-bf148bec49bd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:26.229801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57fbca-0fd2-4fe1-82c5-bf148bec49bd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:26.239091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814aa35-9b73-430c-93e8-6780177072b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:26.241561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814aa35-9b73-430c-93e8-6780177072b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.241561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814aa35-9b73-430c-93e8-6780177072b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.241936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814aa35-9b73-430c-93e8-6780177072b8 admin admin] PATH_INFO: `/v3/projects/8e953230e5b8435181d6c627c96231bd/users/dbbd1f0181064a39bc44c9b9c5d1742c/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.245788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814aa35-9b73-430c-93e8-6780177072b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e953230e5b8435181d6c627c96231bd, user_id=dbbd1f0181064a39bc44c9b9c5d1742c, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:26.251975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814aa35-9b73-430c-93e8-6780177072b8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:26.262753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654298d5-51e3-4fd2-a620-78b67700b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:26.263831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654298d5-51e3-4fd2-a620-78b67700b869 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.264346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654298d5-51e3-4fd2-a620-78b67700b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.264632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654298d5-51e3-4fd2-a620-78b67700b869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.265597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654298d5-51e3-4fd2-a620-78b67700b869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:26.267559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654298d5-51e3-4fd2-a620-78b67700b869 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:26.272938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1040/2086] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:26 2022] PUT /identity/v3/projects/8e953230e5b8435181d6c627c96231bd/users/dbbd1f0181064a39bc44c9b9c5d1742c/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:26.285608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1047/2087] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:26.287427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814aa35-9b73-430c-93e8-6780177072b8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:26.290567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81789-2a8a-4382-b50e-ad8e317377bb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.291049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81789-2a8a-4382-b50e-ad8e317377bb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.291483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81789-2a8a-4382-b50e-ad8e317377bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.318975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:26.340036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bce81789-2a8a-4382-b50e-ad8e317377bb None None] MFA Rules not processed for user `dbbd1f0181064a39bc44c9b9c5d1742c`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:26.342012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bce81789-2a8a-4382-b50e-ad8e317377bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:26.417344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814aa35-9b73-430c-93e8-6780177072b8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:26.424689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609f578-867b-487d-92f6-4d97fe12f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:26.425424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609f578-867b-487d-92f6-4d97fe12f021 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.425717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609f578-867b-487d-92f6-4d97fe12f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.426026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609f578-867b-487d-92f6-4d97fe12f021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.426883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609f578-867b-487d-92f6-4d97fe12f021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:26.430975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609f578-867b-487d-92f6-4d97fe12f021 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:26.454977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1041/2088] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:26.461924 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609f578-867b-487d-92f6-4d97fe12f021 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:26.480049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609f578-867b-487d-92f6-4d97fe12f021 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:26.486147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c691-e25e-4da0-9efe-5a6ccc73a30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:26.487160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c691-e25e-4da0-9efe-5a6ccc73a30b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.487605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c691-e25e-4da0-9efe-5a6ccc73a30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.488685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c691-e25e-4da0-9efe-5a6ccc73a30b admin admin] PATH_INFO: `/v3/projects/16ef6b60b5774790994841f462fb17cd/users/41fe5d52884f4aabbb2fd44b3bcc081d/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.508727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1048/2089] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:26.518486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60c691-e25e-4da0-9efe-5a6ccc73a30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ef6b60b5774790994841f462fb17cd, user_id=41fe5d52884f4aabbb2fd44b3bcc081d, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:26.521296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60c691-e25e-4da0-9efe-5a6ccc73a30b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:26.544410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce81789-2a8a-4382-b50e-ad8e317377bb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:26.546876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bce81789-2a8a-4382-b50e-ad8e317377bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:26.561666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1042/2090] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:26 2022] PUT /identity/v3/projects/16ef6b60b5774790994841f462fb17cd/users/41fe5d52884f4aabbb2fd44b3bcc081d/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:26.583654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62507b6-cb6e-46c9-84e4-56a2f801b93c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.584309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62507b6-cb6e-46c9-84e4-56a2f801b93c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.584911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62507b6-cb6e-46c9-84e4-56a2f801b93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.639286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d62507b6-cb6e-46c9-84e4-56a2f801b93c None None] MFA Rules not processed for user `41fe5d52884f4aabbb2fd44b3bcc081d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:26.642031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d62507b6-cb6e-46c9-84e4-56a2f801b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:26.709546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce81789-2a8a-4382-b50e-ad8e317377bb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:26.730621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:26.772606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1043/2091] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:26.778011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62507b6-cb6e-46c9-84e4-56a2f801b93c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:26.800413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5b032-1a58-4a62-a241-6afdb6ac21c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:26.801751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5b032-1a58-4a62-a241-6afdb6ac21c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.802294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5b032-1a58-4a62-a241-6afdb6ac21c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.802960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5b032-1a58-4a62-a241-6afdb6ac21c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.806317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-57b5b032-1a58-4a62-a241-6afdb6ac21c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:26.893793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62507b6-cb6e-46c9-84e4-56a2f801b93c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:26.900876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2545c-5744-4835-9b37-3a99b061225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:26.901744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2545c-5744-4835-9b37-3a99b061225b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:26.902201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2545c-5744-4835-9b37-3a99b061225b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:26.902626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2545c-5744-4835-9b37-3a99b061225b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:26.903677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2545c-5744-4835-9b37-3a99b061225b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:26.906314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2545c-5744-4835-9b37-3a99b061225b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:26.913550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5b032-1a58-4a62-a241-6afdb6ac21c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:26.915526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5b032-1a58-4a62-a241-6afdb6ac21c8 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:26.930698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1049/2092] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:58:26.946434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1044/2093] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:26 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:26.951707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5b032-1a58-4a62-a241-6afdb6ac21c8 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:26.973529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5b032-1a58-4a62-a241-6afdb6ac21c8 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:27.073334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a181d7-4725-4df0-93ef-67519404d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:27.074054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a181d7-4725-4df0-93ef-67519404d5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:27.074377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a181d7-4725-4df0-93ef-67519404d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:27.074822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a181d7-4725-4df0-93ef-67519404d5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:27.075570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a181d7-4725-4df0-93ef-67519404d5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:27.077851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a181d7-4725-4df0-93ef-67519404d5a8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:27.107046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1050/2094] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:26 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:27.112732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2545c-5744-4835-9b37-3a99b061225b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:27.120837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:27.126345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2545c-5744-4835-9b37-3a99b061225b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:27.135629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf28d-2d34-4d5b-b6e2-e6edf2fdc445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:27.136802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf28d-2d34-4d5b-b6e2-e6edf2fdc445 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:27.137161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf28d-2d34-4d5b-b6e2-e6edf2fdc445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:27.137599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bf28d-2d34-4d5b-b6e2-e6edf2fdc445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:27.138687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bf28d-2d34-4d5b-b6e2-e6edf2fdc445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:27.140539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bf28d-2d34-4d5b-b6e2-e6edf2fdc445 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:27.155783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1045/2095] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:27.160947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a181d7-4725-4df0-93ef-67519404d5a8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:27.175098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a181d7-4725-4df0-93ef-67519404d5a8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:27.181567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75815d-090c-4116-9abc-7ebd31131737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:27.182661 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75815d-090c-4116-9abc-7ebd31131737 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:27.183141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75815d-090c-4116-9abc-7ebd31131737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:27.183706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75815d-090c-4116-9abc-7ebd31131737 admin admin] PATH_INFO: `/v3/projects/3bb63311d7ab4b62a4bd99bc53a29cb9/users/465b917ad1114071aa756dfbffa92a8b/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:27.210403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75815d-090c-4116-9abc-7ebd31131737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb63311d7ab4b62a4bd99bc53a29cb9, user_id=465b917ad1114071aa756dfbffa92a8b, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:27.214646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75815d-090c-4116-9abc-7ebd31131737 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:27.259124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf28d-2d34-4d5b-b6e2-e6edf2fdc445 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:27.259748 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1051/2096] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:27 2022] PUT /identity/v3/projects/3bb63311d7ab4b62a4bd99bc53a29cb9/users/465b917ad1114071aa756dfbffa92a8b/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:27.275251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bf28d-2d34-4d5b-b6e2-e6edf2fdc445 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:27.397588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6a959-4e13-4860-ac92-cae69e2f35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:27.398959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a959-4e13-4860-ac92-cae69e2f35c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:27.399529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a959-4e13-4860-ac92-cae69e2f35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:27.400082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6a959-4e13-4860-ac92-cae69e2f35c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:27.401672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6a959-4e13-4860-ac92-cae69e2f35c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:27.405047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6a959-4e13-4860-ac92-cae69e2f35c8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:27.427000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1046/2097] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:27.431034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75815d-090c-4116-9abc-7ebd31131737 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:27.446495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75815d-090c-4116-9abc-7ebd31131737 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:27.453280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1509a2-55ee-4ab2-9828-1d4838aee673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:27.454336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1509a2-55ee-4ab2-9828-1d4838aee673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:27.454633 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1509a2-55ee-4ab2-9828-1d4838aee673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:27.454914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1509a2-55ee-4ab2-9828-1d4838aee673 admin admin] PATH_INFO: `/v3/projects/3bb63311d7ab4b62a4bd99bc53a29cb9/users/465b917ad1114071aa756dfbffa92a8b/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:27.457879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1509a2-55ee-4ab2-9828-1d4838aee673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb63311d7ab4b62a4bd99bc53a29cb9, user_id=465b917ad1114071aa756dfbffa92a8b, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:27.461382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1509a2-55ee-4ab2-9828-1d4838aee673 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:27.486593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1052/2098] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:27 2022] PUT /identity/v3/projects/3bb63311d7ab4b62a4bd99bc53a29cb9/users/465b917ad1114071aa756dfbffa92a8b/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:27.496983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b3c6-6d31-4707-a245-845b516bc9c7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:27.497508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b3c6-6d31-4707-a245-845b516bc9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:27.498024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b3c6-6d31-4707-a245-845b516bc9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:27.555526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-00c0b3c6-6d31-4707-a245-845b516bc9c7 None None] MFA Rules not processed for user `465b917ad1114071aa756dfbffa92a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:27.557431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-00c0b3c6-6d31-4707-a245-845b516bc9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:27.686155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1047/2099] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:27.705944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1509a2-55ee-4ab2-9828-1d4838aee673 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:27.707779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1b1509a2-55ee-4ab2-9828-1d4838aee673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:27.743643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:27.790286 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1509a2-55ee-4ab2-9828-1d4838aee673 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:27.796229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d280cab-0950-4190-a1eb-fb914e45c877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:27.797007 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280cab-0950-4190-a1eb-fb914e45c877 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:27.797570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280cab-0950-4190-a1eb-fb914e45c877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:27.797855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280cab-0950-4190-a1eb-fb914e45c877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:27.809925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d280cab-0950-4190-a1eb-fb914e45c877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:27.818754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d280cab-0950-4190-a1eb-fb914e45c877 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:27.825438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1053/2100] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:27.984432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0b3c6-6d31-4707-a245-845b516bc9c7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:27.995580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0b3c6-6d31-4707-a245-845b516bc9c7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:27.996259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d280cab-0950-4190-a1eb-fb914e45c877 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:28.001151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426a9eb-fb50-41c7-870c-3b3b051de262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:28.001940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2d280cab-0950-4190-a1eb-fb914e45c877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:28.002388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a9eb-fb50-41c7-870c-3b3b051de262 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:28.002388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a9eb-fb50-41c7-870c-3b3b051de262 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:28.002729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a9eb-fb50-41c7-870c-3b3b051de262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:28.099163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d280cab-0950-4190-a1eb-fb914e45c877 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:28.104106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:28.105612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:28.105612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:28.105838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] PATH_INFO: `/v3/users/08b9e0990bf64d8fb3a2e8e737fae892` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:28.107300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b9e0990bf64d8fb3a2e8e737fae892)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:28.109395 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:28.110148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426a9eb-fb50-41c7-870c-3b3b051de262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:28.114228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426a9eb-fb50-41c7-870c-3b3b051de262 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:28.132301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1048/2101] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:28.214190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b9e0990bf64d8fb3a2e8e737fae892'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.215950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b9e0990bf64d8fb3a2e8e737fae892'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.216693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b9e0990bf64d8fb3a2e8e737fae892'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.227541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b9e0990bf64d8fb3a2e8e737fae892'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.238344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b9e0990bf64d8fb3a2e8e737fae892'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.298682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1054/2102] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:27 2022] DELETE /identity/v3/users/08b9e0990bf64d8fb3a2e8e737fae892 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:28.303495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5581109-43bf-4e1a-8dff-07b348330821 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:28.303795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5581109-43bf-4e1a-8dff-07b348330821 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:28.304133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5581109-43bf-4e1a-8dff-07b348330821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:28.346279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b5581109-43bf-4e1a-8dff-07b348330821 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:28.348406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b5581109-43bf-4e1a-8dff-07b348330821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:28.402474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:28.482806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1049/2103] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:28.495238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:28.497827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:28.551537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5581109-43bf-4e1a-8dff-07b348330821 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:28.554252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b5581109-43bf-4e1a-8dff-07b348330821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:28.578048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5581109-43bf-4e1a-8dff-07b348330821 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:28.587169 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:28.588842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:28.589349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:28.589923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] PATH_INFO: `/v3/users/41fe5d52884f4aabbb2fd44b3bcc081d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:28.592235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:28.592533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=41fe5d52884f4aabbb2fd44b3bcc081d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:28.597100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:28.606466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8f5fe-b227-4dff-91ae-832e4c442972 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:28.616220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bf37f-0562-4584-861b-a3c83fc308dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:28.617412 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bf37f-0562-4584-861b-a3c83fc308dd service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:28.617963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bf37f-0562-4584-861b-a3c83fc308dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:28.618556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bf37f-0562-4584-861b-a3c83fc308dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:28.636815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bf37f-0562-4584-861b-a3c83fc308dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:28.639633 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bf37f-0562-4584-861b-a3c83fc308dd service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:28.658999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1055/2104] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:28.692797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fe5d52884f4aabbb2fd44b3bcc081d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.716236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fe5d52884f4aabbb2fd44b3bcc081d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.717417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fe5d52884f4aabbb2fd44b3bcc081d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.734878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fe5d52884f4aabbb2fd44b3bcc081d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.762982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fe5d52884f4aabbb2fd44b3bcc081d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:28.788610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1050/2105] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:28 2022] DELETE /identity/v3/users/41fe5d52884f4aabbb2fd44b3bcc081d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:28.794183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f03ff-884e-40df-9227-0fd62f8ea2a6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:28.794838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f03ff-884e-40df-9227-0fd62f8ea2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:28.795297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f03ff-884e-40df-9227-0fd62f8ea2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:28.855435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-816f03ff-884e-40df-9227-0fd62f8ea2a6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:28.857088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-816f03ff-884e-40df-9227-0fd62f8ea2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:28.950208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:28.954395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:28.979619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1056/2106] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:29.010609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f03ff-884e-40df-9227-0fd62f8ea2a6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:29.013191 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-816f03ff-884e-40df-9227-0fd62f8ea2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:29.145620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116e026-4007-40fe-acfb-2a6408d22ddf admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:29.160369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4614b7e-3a38-424d-a2ad-898040dbf787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:29.161250 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4614b7e-3a38-424d-a2ad-898040dbf787 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:29.161680 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4614b7e-3a38-424d-a2ad-898040dbf787 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:29.162080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4614b7e-3a38-424d-a2ad-898040dbf787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:29.168068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b4614b7e-3a38-424d-a2ad-898040dbf787 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:29.213078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f03ff-884e-40df-9227-0fd62f8ea2a6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:29.226852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bc6f4-0582-49e7-a9f2-4d59cf51eb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:29.227547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bc6f4-0582-49e7-a9f2-4d59cf51eb0f service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:29.227836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bc6f4-0582-49e7-a9f2-4d59cf51eb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:29.228117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bc6f4-0582-49e7-a9f2-4d59cf51eb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:29.250749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bc6f4-0582-49e7-a9f2-4d59cf51eb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:29.253341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bc6f4-0582-49e7-a9f2-4d59cf51eb0f service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:29.274194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:29.288290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1057/2107] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:58:29.363579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4614b7e-3a38-424d-a2ad-898040dbf787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:29.365150 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4614b7e-3a38-424d-a2ad-898040dbf787 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:29.401534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1051/2108] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:58:29.406260 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bc6f4-0582-49e7-a9f2-4d59cf51eb0f service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:29.410859 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-300bc6f4-0582-49e7-a9f2-4d59cf51eb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:29.457402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bc6f4-0582-49e7-a9f2-4d59cf51eb0f service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:29.482962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:29.488352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:29.489263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:29.490952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] PATH_INFO: `/v3/projects/00b18aee8e054f3788526e48f771ac43` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:29.495849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b18aee8e054f3788526e48f771ac43)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:29.500100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:29.572160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b18aee8e054f3788526e48f771ac43', 'request_id': 'req-1e48b61c-8746-4606-bc00-631189752209'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.583772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b18aee8e054f3788526e48f771ac43', 'request_id': 'req-1e48b61c-8746-4606-bc00-631189752209'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.595024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b18aee8e054f3788526e48f771ac43', 'request_id': 'req-1e48b61c-8746-4606-bc00-631189752209'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.631583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] The token cache is being invalidate because project 00b18aee8e054f3788526e48f771ac43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:29.632091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.633368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.638659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1058/2109] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:29 2022] DELETE /identity/v3/projects/00b18aee8e054f3788526e48f771ac43 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:29.644853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4614b7e-3a38-424d-a2ad-898040dbf787 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:29.676371 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4614b7e-3a38-424d-a2ad-898040dbf787 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:29.765420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:29.767734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:29.768223 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:29.768734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] PATH_INFO: `/v3/users/445dec0247674bc9bca25e4c0ec39af1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:29.771201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] RBAC: Authorizing `identity:delete_user(user_id=445dec0247674bc9bca25e4c0ec39af1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:29.772861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:29.841778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445dec0247674bc9bca25e4c0ec39af1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.860079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445dec0247674bc9bca25e4c0ec39af1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.861459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445dec0247674bc9bca25e4c0ec39af1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.876730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445dec0247674bc9bca25e4c0ec39af1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.890660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445dec0247674bc9bca25e4c0ec39af1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:29.907702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1052/2110] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:29 2022] DELETE /identity/v3/users/445dec0247674bc9bca25e4c0ec39af1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:30.140758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:30.143493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:30.180805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48b61c-8746-4606-bc00-631189752209 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:30.213315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:30.326947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:30.328524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:30.329010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:30.329448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] PATH_INFO: `/v3/projects/16ef6b60b5774790994841f462fb17cd` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:30.331694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ef6b60b5774790994841f462fb17cd)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:30.335476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:30.362977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:30.362977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:30.439914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebc6e5-d61a-4e1f-90a5-ddd4a53d956f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:30.480415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:30.481390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:30.481643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:30.482133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] PATH_INFO: `/v3/users/2f9474ef84414a50bb76bcc1435863a2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:30.483688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9474ef84414a50bb76bcc1435863a2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:30.486050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:30.511925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ef6b60b5774790994841f462fb17cd', 'request_id': 'req-acc017a6-0ba4-44c1-af4d-501a4a38fec9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.532060 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ef6b60b5774790994841f462fb17cd', 'request_id': 'req-acc017a6-0ba4-44c1-af4d-501a4a38fec9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.577041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ef6b60b5774790994841f462fb17cd', 'request_id': 'req-acc017a6-0ba4-44c1-af4d-501a4a38fec9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.599308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] The token cache is being invalidate because project 16ef6b60b5774790994841f462fb17cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:30.599648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.600476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.603259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1059/2111] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:30 2022] DELETE /identity/v3/projects/16ef6b60b5774790994841f462fb17cd => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:30.604539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:30.611864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:30.637576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9474ef84414a50bb76bcc1435863a2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.649194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:30.664289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9474ef84414a50bb76bcc1435863a2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.665321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9474ef84414a50bb76bcc1435863a2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.684768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9474ef84414a50bb76bcc1435863a2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.696657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9474ef84414a50bb76bcc1435863a2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.714120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1053/2112] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:30 2022] DELETE /identity/v3/users/2f9474ef84414a50bb76bcc1435863a2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:30.714120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:30.716124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:30.738947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc017a6-0ba4-44c1-af4d-501a4a38fec9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:30.817898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa1414-368e-4f38-ad67-e18dc6288bbe admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:30.826296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:30.827790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:30.828390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:30.828973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:30.833809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:30.835076 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:30.857629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:30.859560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:30.859891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:30.860177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] PATH_INFO: `/v3/projects/f55cd0334bab498f90bcf8f595c1d4a3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:30.862528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55cd0334bab498f90bcf8f595c1d4a3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:30.866354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:30.967594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55cd0334bab498f90bcf8f595c1d4a3', 'request_id': 'req-b142c725-9a59-4346-8127-44febb39ab8a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.972268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:30.975233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:30.976584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55cd0334bab498f90bcf8f595c1d4a3', 'request_id': 'req-b142c725-9a59-4346-8127-44febb39ab8a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.988347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55cd0334bab498f90bcf8f595c1d4a3', 'request_id': 'req-b142c725-9a59-4346-8127-44febb39ab8a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:30.990815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1054/2113] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:30.991642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:30.993326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:31.011064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a4e8-9d1f-4146-9b04-a2767ad56ca3 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:31.050845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] The token cache is being invalidate because project f55cd0334bab498f90bcf8f595c1d4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:31.051337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:31.052432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b142c725-9a59-4346-8127-44febb39ab8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:31.060882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1060/2114] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:30 2022] DELETE /identity/v3/projects/f55cd0334bab498f90bcf8f595c1d4a3 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:31.063267 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2499f8-5b4d-4e9f-933f-031a157506c2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.063794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2499f8-5b4d-4e9f-933f-031a157506c2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.064248 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2499f8-5b4d-4e9f-933f-031a157506c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.089247 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:31.090876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.091333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.091949 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] PATH_INFO: `/v3/users/465b917ad1114071aa756dfbffa92a8b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.093615 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=465b917ad1114071aa756dfbffa92a8b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:31.096740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:31.119479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8d2499f8-5b4d-4e9f-933f-031a157506c2 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:31.121576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8d2499f8-5b4d-4e9f-933f-031a157506c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:31.144505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1061/2115] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:31.146315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866504b1-d71d-469d-8eb6-d4217a459e00 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.146702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866504b1-d71d-469d-8eb6-d4217a459e00 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.147071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866504b1-d71d-469d-8eb6-d4217a459e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.151481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:31.189797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-866504b1-d71d-469d-8eb6-d4217a459e00 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:31.191451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-866504b1-d71d-469d-8eb6-d4217a459e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:31.198666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465b917ad1114071aa756dfbffa92a8b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:31.206139 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1062/2116] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:31.213794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866504b1-d71d-469d-8eb6-d4217a459e00 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:31.216176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-866504b1-d71d-469d-8eb6-d4217a459e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:31.230221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465b917ad1114071aa756dfbffa92a8b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:31.231108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465b917ad1114071aa756dfbffa92a8b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:31.245152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465b917ad1114071aa756dfbffa92a8b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:31.266428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b24427a8-1f3a-4a92-8ae2-334439510eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465b917ad1114071aa756dfbffa92a8b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:31.267604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1055/2117] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:30 2022] DELETE /identity/v3/users/465b917ad1114071aa756dfbffa92a8b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:31.274293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d3a9-ae88-44aa-94b2-1abe34bf482b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.274293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d3a9-ae88-44aa-94b2-1abe34bf482b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.274293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d3a9-ae88-44aa-94b2-1abe34bf482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.292526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866504b1-d71d-469d-8eb6-d4217a459e00 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:31.302608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9884d3a9-ae88-44aa-94b2-1abe34bf482b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:31.305270 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9884d3a9-ae88-44aa-94b2-1abe34bf482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:31.403141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd3c1-5d12-43de-8ff0-3a6d40ed5fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:31.404247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd3c1-5d12-43de-8ff0-3a6d40ed5fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.404800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd3c1-5d12-43de-8ff0-3a6d40ed5fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.405322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd3c1-5d12-43de-8ff0-3a6d40ed5fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.405847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1056/2118] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:31.411870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d3a9-ae88-44aa-94b2-1abe34bf482b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:31.412601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-17ffd3c1-5d12-43de-8ff0-3a6d40ed5fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:31.430518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d3a9-ae88-44aa-94b2-1abe34bf482b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:31.436707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98cf4-07af-400b-8582-64f080d1d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:31.438265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98cf4-07af-400b-8582-64f080d1d113 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.439176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98cf4-07af-400b-8582-64f080d1d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.440177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98cf4-07af-400b-8582-64f080d1d113 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.441297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb98cf4-07af-400b-8582-64f080d1d113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:31.441474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffd3c1-5d12-43de-8ff0-3a6d40ed5fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:31.441806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb98cf4-07af-400b-8582-64f080d1d113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:31.443688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffd3c1-5d12-43de-8ff0-3a6d40ed5fc7 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:31.446724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb98cf4-07af-400b-8582-64f080d1d113 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:31.458188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1063/2119] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:31.470464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1057/2120] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:58:31.477255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd3c1-5d12-43de-8ff0-3a6d40ed5fc7 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:31.492184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd3c1-5d12-43de-8ff0-3a6d40ed5fc7 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:31.499507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea324f-4aa0-463b-a2e8-097ba21b6d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:31.501223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea324f-4aa0-463b-a2e8-097ba21b6d7b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.501769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea324f-4aa0-463b-a2e8-097ba21b6d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.502361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea324f-4aa0-463b-a2e8-097ba21b6d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.503634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea324f-4aa0-463b-a2e8-097ba21b6d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:31.508285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea324f-4aa0-463b-a2e8-097ba21b6d7b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:31.548672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1064/2121] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:31 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:31.553212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98cf4-07af-400b-8582-64f080d1d113 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:31.568036 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98cf4-07af-400b-8582-64f080d1d113 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:31.657557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0dc4a-fb76-47a2-afa6-f11bea91a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:31.658676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0dc4a-fb76-47a2-afa6-f11bea91a03f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.659167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0dc4a-fb76-47a2-afa6-f11bea91a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.660343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0dc4a-fb76-47a2-afa6-f11bea91a03f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.661587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0dc4a-fb76-47a2-afa6-f11bea91a03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:31.664432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0dc4a-fb76-47a2-afa6-f11bea91a03f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:31.708902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1058/2122] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:31 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:31.709972 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea324f-4aa0-463b-a2e8-097ba21b6d7b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:31.723664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea324f-4aa0-463b-a2e8-097ba21b6d7b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:31.731446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c541f96-7c38-4f59-a0da-c527b381d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:31.732285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c541f96-7c38-4f59-a0da-c527b381d943 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.732643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c541f96-7c38-4f59-a0da-c527b381d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.733036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c541f96-7c38-4f59-a0da-c527b381d943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.734391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c541f96-7c38-4f59-a0da-c527b381d943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:31.736365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c541f96-7c38-4f59-a0da-c527b381d943 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:31.737994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:31.765553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0dc4a-fb76-47a2-afa6-f11bea91a03f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:31.777237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0dc4a-fb76-47a2-afa6-f11bea91a03f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:31.778237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1065/2123] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:58:31.783661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2753e-922b-4957-b4ea-c6451b27440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:31.784430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2753e-922b-4957-b4ea-c6451b27440f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.784736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2753e-922b-4957-b4ea-c6451b27440f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.785017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2753e-922b-4957-b4ea-c6451b27440f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.785833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2753e-922b-4957-b4ea-c6451b27440f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:31.787820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2753e-922b-4957-b4ea-c6451b27440f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:31.814458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c541f96-7c38-4f59-a0da-c527b381d943 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:31.826389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c541f96-7c38-4f59-a0da-c527b381d943 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:31.827173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1059/2124] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:31.833794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd43b-9462-4828-9761-d950c6a7a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:31.834948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd43b-9462-4828-9761-d950c6a7a9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.835348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd43b-9462-4828-9761-d950c6a7a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.835801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd43b-9462-4828-9761-d950c6a7a9a8 admin admin] PATH_INFO: `/v3/projects/9140bf138ea54c079231b49535a4995e/users/5a484edbf1c341c4b772dab0f1597694/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.858046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fd43b-9462-4828-9761-d950c6a7a9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9140bf138ea54c079231b49535a4995e, user_id=5a484edbf1c341c4b772dab0f1597694, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:31.861724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fd43b-9462-4828-9761-d950c6a7a9a8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:31.890366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1066/2125] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:31 2022] PUT /identity/v3/projects/9140bf138ea54c079231b49535a4995e/users/5a484edbf1c341c4b772dab0f1597694/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:31.895616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05729ad7-f046-437f-bdcd-c8b58fc7f05b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:31.896022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05729ad7-f046-437f-bdcd-c8b58fc7f05b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:31.896405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05729ad7-f046-437f-bdcd-c8b58fc7f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:31.912518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:31.919153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-05729ad7-f046-437f-bdcd-c8b58fc7f05b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:31.921776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-05729ad7-f046-437f-bdcd-c8b58fc7f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:32.031617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1060/2126] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:32.040271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd43b-9462-4828-9761-d950c6a7a9a8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:32.042510 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7f7fd43b-9462-4828-9761-d950c6a7a9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:32.053216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05729ad7-f046-437f-bdcd-c8b58fc7f05b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:32.060256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-05729ad7-f046-437f-bdcd-c8b58fc7f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:32.074377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd43b-9462-4828-9761-d950c6a7a9a8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:32.088133 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:32.091120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:32.091720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:32.093455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] PATH_INFO: `/v3/projects/3bb63311d7ab4b62a4bd99bc53a29cb9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:32.099150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb63311d7ab4b62a4bd99bc53a29cb9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:32.103367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:32.172579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05729ad7-f046-437f-bdcd-c8b58fc7f05b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:32.173786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb63311d7ab4b62a4bd99bc53a29cb9', 'request_id': 'req-b6adfb71-df5c-4d34-9cc8-c585148e70fd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.194576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb63311d7ab4b62a4bd99bc53a29cb9', 'request_id': 'req-b6adfb71-df5c-4d34-9cc8-c585148e70fd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.214819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb63311d7ab4b62a4bd99bc53a29cb9', 'request_id': 'req-b6adfb71-df5c-4d34-9cc8-c585148e70fd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.230918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] The token cache is being invalidate because project 3bb63311d7ab4b62a4bd99bc53a29cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:32.231496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.232499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6adfb71-df5c-4d34-9cc8-c585148e70fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.234575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1067/2127] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:32 2022] DELETE /identity/v3/projects/3bb63311d7ab4b62a4bd99bc53a29cb9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:58:32.240052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b08e-909c-4698-a58d-f244ea136eb7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:32.240377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b08e-909c-4698-a58d-f244ea136eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:32.240627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b08e-909c-4698-a58d-f244ea136eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:32.253910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7697b9b-68b6-4322-b2cb-7d14e5fee387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:32.255870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7697b9b-68b6-4322-b2cb-7d14e5fee387 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:32.256504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7697b9b-68b6-4322-b2cb-7d14e5fee387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:32.256928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7697b9b-68b6-4322-b2cb-7d14e5fee387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:32.260143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c7697b9b-68b6-4322-b2cb-7d14e5fee387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:32.265851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5493b08e-909c-4698-a58d-f244ea136eb7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:32.269897 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5493b08e-909c-4698-a58d-f244ea136eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:32.375774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1068/2128] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:32.383045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7697b9b-68b6-4322-b2cb-7d14e5fee387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:32.384289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7697b9b-68b6-4322-b2cb-7d14e5fee387 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:32.385533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe9f3-caf8-45e9-8c86-4c5b94c3da64 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:32.386015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe9f3-caf8-45e9-8c86-4c5b94c3da64 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:32.386461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe9f3-caf8-45e9-8c86-4c5b94c3da64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:32.414974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-92ebe9f3-caf8-45e9-8c86-4c5b94c3da64 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:32.416115 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1061/2129] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:32.429150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-92ebe9f3-caf8-45e9-8c86-4c5b94c3da64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:32.450718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1069/2130] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:32.455802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7697b9b-68b6-4322-b2cb-7d14e5fee387 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:32.469604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7697b9b-68b6-4322-b2cb-7d14e5fee387 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:32.481836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:32.482633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:32.483013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:32.483312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:32.484688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:32.485005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:32.486849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:32.501753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:32.510779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1062/2131] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:58:32.513790 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe9f3-caf8-45e9-8c86-4c5b94c3da64 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:32.528176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe9f3-caf8-45e9-8c86-4c5b94c3da64 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:32.539929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531bbb4-4e79-4a75-964d-db8c991a9c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:32.540709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531bbb4-4e79-4a75-964d-db8c991a9c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:32.541368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531bbb4-4e79-4a75-964d-db8c991a9c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:32.541668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531bbb4-4e79-4a75-964d-db8c991a9c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:32.542421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531bbb4-4e79-4a75-964d-db8c991a9c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:32.544783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531bbb4-4e79-4a75-964d-db8c991a9c7a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:32.597835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:32.600665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:32.619886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1070/2132] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:32 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:32.622938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531bbb4-4e79-4a75-964d-db8c991a9c7a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:32.628948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6594-6afc-4af6-b55d-b7dde70199b6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:32.784490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:32.786559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:32.788009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:32.788416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] PATH_INFO: `/v3/projects/44ae48454e604ef1a9cbe0df12c1d978` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:32.791253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ae48454e604ef1a9cbe0df12c1d978)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:32.794588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:32.796087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:32.899244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531bbb4-4e79-4a75-964d-db8c991a9c7a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:32.914966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ae48454e604ef1a9cbe0df12c1d978', 'request_id': 'req-44222f26-2b49-4422-ad0e-d7bb7e056b1e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.932164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ae48454e604ef1a9cbe0df12c1d978', 'request_id': 'req-44222f26-2b49-4422-ad0e-d7bb7e056b1e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.949717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ae48454e604ef1a9cbe0df12c1d978', 'request_id': 'req-44222f26-2b49-4422-ad0e-d7bb7e056b1e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.985367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] The token cache is being invalidate because project 44ae48454e604ef1a9cbe0df12c1d978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:32.985925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.987684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44222f26-2b49-4422-ad0e-d7bb7e056b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:32.993527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1063/2133] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:32 2022] DELETE /identity/v3/projects/44ae48454e604ef1a9cbe0df12c1d978 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:33.012681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03840aa3-4f44-474d-b07b-476ac3a4762c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.014493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03840aa3-4f44-474d-b07b-476ac3a4762c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.015218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03840aa3-4f44-474d-b07b-476ac3a4762c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.054215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf08d8-ac98-4f73-8538-c1d9f9ebc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.055151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf08d8-ac98-4f73-8538-c1d9f9ebc2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.055445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf08d8-ac98-4f73-8538-c1d9f9ebc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.055775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf08d8-ac98-4f73-8538-c1d9f9ebc2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.056498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf08d8-ac98-4f73-8538-c1d9f9ebc2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.058692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf08d8-ac98-4f73-8538-c1d9f9ebc2f4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.077440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-03840aa3-4f44-474d-b07b-476ac3a4762c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:33.078290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-03840aa3-4f44-474d-b07b-476ac3a4762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:33.110954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1064/2134] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:33.112872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5f819-a6b6-49b2-ace8-e5785d64eff4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.113020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5f819-a6b6-49b2-ace8-e5785d64eff4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.113379 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5f819-a6b6-49b2-ace8-e5785d64eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.115733 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1071/2135] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:32 2022] POST /identity/v3/users => generated 285 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:33.116686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf08d8-ac98-4f73-8538-c1d9f9ebc2f4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.125470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-87cf08d8-ac98-4f73-8538-c1d9f9ebc2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:33.153152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf08d8-ac98-4f73-8538-c1d9f9ebc2f4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:33.155603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-aec5f819-a6b6-49b2-ace8-e5785d64eff4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:33.156971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aec5f819-a6b6-49b2-ace8-e5785d64eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:33.164808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a27355-e2e0-4525-9548-dbc204721a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.164808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a27355-e2e0-4525-9548-dbc204721a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.164808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a27355-e2e0-4525-9548-dbc204721a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.165464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a27355-e2e0-4525-9548-dbc204721a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.167683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a27355-e2e0-4525-9548-dbc204721a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.170774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a27355-e2e0-4525-9548-dbc204721a94 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.195513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1065/2137] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:33.199651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1072/2137] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:33.201353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5f819-a6b6-49b2-ace8-e5785d64eff4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.203438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a27355-e2e0-4525-9548-dbc204721a94 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.227052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a27355-e2e0-4525-9548-dbc204721a94 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:33.229339 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5f819-a6b6-49b2-ace8-e5785d64eff4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:33.239398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1368f-f08d-44ad-ab26-7ecbce2fe879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.241977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1368f-f08d-44ad-ab26-7ecbce2fe879 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.242484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b2b1f-545c-4476-83a2-0f91b794b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.242965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1368f-f08d-44ad-ab26-7ecbce2fe879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.243409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1368f-f08d-44ad-ab26-7ecbce2fe879 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.244214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b2b1f-545c-4476-83a2-0f91b794b49e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.245191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b2b1f-545c-4476-83a2-0f91b794b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.245898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1368f-f08d-44ad-ab26-7ecbce2fe879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:33.246853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b2b1f-545c-4476-83a2-0f91b794b49e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.247365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1368f-f08d-44ad-ab26-7ecbce2fe879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.249535 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b2b1f-545c-4476-83a2-0f91b794b49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.255520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1368f-f08d-44ad-ab26-7ecbce2fe879 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.258915 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b2b1f-545c-4476-83a2-0f91b794b49e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.318148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1066/2138] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:33.323787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b2b1f-545c-4476-83a2-0f91b794b49e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.325179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1073/2139] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:58:33.329685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1368f-f08d-44ad-ab26-7ecbce2fe879 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.346029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1368f-f08d-44ad-ab26-7ecbce2fe879 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:33.349265 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b2b1f-545c-4476-83a2-0f91b794b49e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:33.352349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75890b57-cbe5-44f1-8038-716186615b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.353158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75890b57-cbe5-44f1-8038-716186615b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.353918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75890b57-cbe5-44f1-8038-716186615b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.354292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75890b57-cbe5-44f1-8038-716186615b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.355241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75890b57-cbe5-44f1-8038-716186615b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.357518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75890b57-cbe5-44f1-8038-716186615b5e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.370587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77980dbf-cf2d-4a18-98e2-a7dcde66b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.372166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980dbf-cf2d-4a18-98e2-a7dcde66b9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.372455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980dbf-cf2d-4a18-98e2-a7dcde66b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.372741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980dbf-cf2d-4a18-98e2-a7dcde66b9b8 admin admin] PATH_INFO: `/v3/projects/5a37524631214651bc19a355c0f61236/users/ba5c5ea52ca44b6691433e4f20feeb62/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.412937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1074/2140] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:33 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:33.418802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77980dbf-cf2d-4a18-98e2-a7dcde66b9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a37524631214651bc19a355c0f61236, user_id=ba5c5ea52ca44b6691433e4f20feeb62, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.421636 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77980dbf-cf2d-4a18-98e2-a7dcde66b9b8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.422233 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75890b57-cbe5-44f1-8038-716186615b5e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.451891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1067/2141] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:33 2022] PUT /identity/v3/projects/5a37524631214651bc19a355c0f61236/users/ba5c5ea52ca44b6691433e4f20feeb62/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:33.463083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefc35c-851f-4d8e-b09d-8b7e2c1286cc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.463382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefc35c-851f-4d8e-b09d-8b7e2c1286cc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.463708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefc35c-851f-4d8e-b09d-8b7e2c1286cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.531010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8eefc35c-851f-4d8e-b09d-8b7e2c1286cc None None] MFA Rules not processed for user `ba5c5ea52ca44b6691433e4f20feeb62`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:33.533851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8eefc35c-851f-4d8e-b09d-8b7e2c1286cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:33.590423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75890b57-cbe5-44f1-8038-716186615b5e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:33.604690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:33.642896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:33.692907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1068/2142] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:33.702491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefc35c-851f-4d8e-b09d-8b7e2c1286cc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.705410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8eefc35c-851f-4d8e-b09d-8b7e2c1286cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:33.751523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af379199-b756-41d1-b181-ddfa3710142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.753452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af379199-b756-41d1-b181-ddfa3710142c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.754577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af379199-b756-41d1-b181-ddfa3710142c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.755691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af379199-b756-41d1-b181-ddfa3710142c admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.757505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af379199-b756-41d1-b181-ddfa3710142c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.762031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af379199-b756-41d1-b181-ddfa3710142c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.813479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1075/2143] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:33 2022] POST /identity/v3/users => generated 290 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:33.819281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af379199-b756-41d1-b181-ddfa3710142c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.820426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefc35c-851f-4d8e-b09d-8b7e2c1286cc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:33.825070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b994fb-3eaf-4ad6-b3e9-20630fa5af68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984780a6a8df405dbbb2ba4c46dd841c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.826569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b994fb-3eaf-4ad6-b3e9-20630fa5af68 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.827190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b994fb-3eaf-4ad6-b3e9-20630fa5af68 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.827542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b994fb-3eaf-4ad6-b3e9-20630fa5af68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.831600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af379199-b756-41d1-b181-ddfa3710142c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:33.840475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd386-6cde-4311-8d92-c46e2951229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.842133 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd386-6cde-4311-8d92-c46e2951229b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.842300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b994fb-3eaf-4ad6-b3e9-20630fa5af68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.842852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd386-6cde-4311-8d92-c46e2951229b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.843503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd386-6cde-4311-8d92-c46e2951229b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.843972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b994fb-3eaf-4ad6-b3e9-20630fa5af68 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.844819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfd386-6cde-4311-8d92-c46e2951229b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.847234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfd386-6cde-4311-8d92-c46e2951229b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.861093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1069/2144] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:58:33.867311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1076/2145] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:33.869278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b994fb-3eaf-4ad6-b3e9-20630fa5af68 service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.897484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b994fb-3eaf-4ad6-b3e9-20630fa5af68 service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:33.907323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d258d07-fa2b-4aec-9d3d-c1a2ed1fc519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:33.910119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d258d07-fa2b-4aec-9d3d-c1a2ed1fc519 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:33.910119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d258d07-fa2b-4aec-9d3d-c1a2ed1fc519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:33.910454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d258d07-fa2b-4aec-9d3d-c1a2ed1fc519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:33.915315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d258d07-fa2b-4aec-9d3d-c1a2ed1fc519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:33.918482 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d258d07-fa2b-4aec-9d3d-c1a2ed1fc519 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:33.937980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1070/2146] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:33.943716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd386-6cde-4311-8d92-c46e2951229b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:33.968155 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd386-6cde-4311-8d92-c46e2951229b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:34.010493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb8516-8823-4a9b-81d2-2561957b5c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:34.013848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb8516-8823-4a9b-81d2-2561957b5c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:34.013848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb8516-8823-4a9b-81d2-2561957b5c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:34.014707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb8516-8823-4a9b-81d2-2561957b5c16 admin admin] PATH_INFO: `/v3/projects/73bf442df39b4f5cbc18f571a0596f10/users/18195083037046bd99166f68690c3dce/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:34.043074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb8516-8823-4a9b-81d2-2561957b5c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bf442df39b4f5cbc18f571a0596f10, user_id=18195083037046bd99166f68690c3dce, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:34.046758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb8516-8823-4a9b-81d2-2561957b5c16 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:34.073662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1077/2147] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:33 2022] PUT /identity/v3/projects/73bf442df39b4f5cbc18f571a0596f10/users/18195083037046bd99166f68690c3dce/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:34.081550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984b3e-77f2-4d87-919a-46f4e7e99b8c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:34.082351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984b3e-77f2-4d87-919a-46f4e7e99b8c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:34.083393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984b3e-77f2-4d87-919a-46f4e7e99b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:34.131121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6b984b3e-77f2-4d87-919a-46f4e7e99b8c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:34.135903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6b984b3e-77f2-4d87-919a-46f4e7e99b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:34.169313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968738ee-1e9e-430f-8e46-367d42ef92ad None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:34.169855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968738ee-1e9e-430f-8e46-367d42ef92ad None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:34.170701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968738ee-1e9e-430f-8e46-367d42ef92ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:34.244980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-968738ee-1e9e-430f-8e46-367d42ef92ad None None] MFA Rules not processed for user `5a484edbf1c341c4b772dab0f1597694`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:34.247023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-968738ee-1e9e-430f-8e46-367d42ef92ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:34.296274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1071/2148] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:34.314568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b984b3e-77f2-4d87-919a-46f4e7e99b8c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:34.323662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6b984b3e-77f2-4d87-919a-46f4e7e99b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:34.487437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b984b3e-77f2-4d87-919a-46f4e7e99b8c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:34.492733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216bd96-64b5-4998-9870-b2f9f60ba65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:34.494504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216bd96-64b5-4998-9870-b2f9f60ba65e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:34.494799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216bd96-64b5-4998-9870-b2f9f60ba65e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:34.495067 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216bd96-64b5-4998-9870-b2f9f60ba65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:34.508463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216bd96-64b5-4998-9870-b2f9f60ba65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:34.510014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1078/2149] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:34.523233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216bd96-64b5-4998-9870-b2f9f60ba65e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:34.531087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968738ee-1e9e-430f-8e46-367d42ef92ad None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:34.531087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-968738ee-1e9e-430f-8e46-367d42ef92ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:34.549787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1072/2150] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:34.581537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968738ee-1e9e-430f-8e46-367d42ef92ad None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:34.591608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2606cb9-22a8-403a-aa80-25a7ee740848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:34.593164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2606cb9-22a8-403a-aa80-25a7ee740848 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:34.593485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2606cb9-22a8-403a-aa80-25a7ee740848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:34.593751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2606cb9-22a8-403a-aa80-25a7ee740848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:34.601305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2606cb9-22a8-403a-aa80-25a7ee740848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:34.607836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2606cb9-22a8-403a-aa80-25a7ee740848 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:34.687117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1079/2151] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:34 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:34.688769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216bd96-64b5-4998-9870-b2f9f60ba65e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:34.713813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216bd96-64b5-4998-9870-b2f9f60ba65e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:34.728888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:34.910827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83139-aa82-40a3-b491-04e792b4ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:34.911684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83139-aa82-40a3-b491-04e792b4ae37 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:34.912045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83139-aa82-40a3-b491-04e792b4ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:34.912399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83139-aa82-40a3-b491-04e792b4ae37 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:34.913207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e83139-aa82-40a3-b491-04e792b4ae37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:34.916865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e83139-aa82-40a3-b491-04e792b4ae37 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:34.948081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1073/2152] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:34 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:34.954567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2606cb9-22a8-403a-aa80-25a7ee740848 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:34.971524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2606cb9-22a8-403a-aa80-25a7ee740848 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:34.978352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355960b6-c571-42eb-b286-460161ef966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:34.979215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355960b6-c571-42eb-b286-460161ef966c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:34.979502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355960b6-c571-42eb-b286-460161ef966c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:34.979773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355960b6-c571-42eb-b286-460161ef966c admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:34.980681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355960b6-c571-42eb-b286-460161ef966c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:34.982389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355960b6-c571-42eb-b286-460161ef966c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:35.004378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1080/2153] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:35.006025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83139-aa82-40a3-b491-04e792b4ae37 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:35.034232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83139-aa82-40a3-b491-04e792b4ae37 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:35.047160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252504e0-2f75-4a13-8c1d-f1bb653b5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:35.051641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252504e0-2f75-4a13-8c1d-f1bb653b5e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:35.052381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252504e0-2f75-4a13-8c1d-f1bb653b5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:35.053148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252504e0-2f75-4a13-8c1d-f1bb653b5e60 admin admin] PATH_INFO: `/v3/projects/5e0815654ada4350b365f8d574bebb2e/users/a3c4e1a5e9614448b31be7823d9b65bb/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:35.083428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252504e0-2f75-4a13-8c1d-f1bb653b5e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0815654ada4350b365f8d574bebb2e, user_id=a3c4e1a5e9614448b31be7823d9b65bb, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:35.087317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252504e0-2f75-4a13-8c1d-f1bb653b5e60 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:35.126215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1074/2154] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:35 2022] PUT /identity/v3/projects/5e0815654ada4350b365f8d574bebb2e/users/a3c4e1a5e9614448b31be7823d9b65bb/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:35.129816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355960b6-c571-42eb-b286-460161ef966c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:35.144081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355960b6-c571-42eb-b286-460161ef966c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:35.222764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:35.285937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c992e-3ae0-4548-89ef-ce5a664f584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:35.286958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c992e-3ae0-4548-89ef-ce5a664f584f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:35.287208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c992e-3ae0-4548-89ef-ce5a664f584f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:35.287708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c992e-3ae0-4548-89ef-ce5a664f584f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:35.288658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c992e-3ae0-4548-89ef-ce5a664f584f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:35.290913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c992e-3ae0-4548-89ef-ce5a664f584f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:35.313798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1081/2155] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:35.314689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252504e0-2f75-4a13-8c1d-f1bb653b5e60 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:35.335733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252504e0-2f75-4a13-8c1d-f1bb653b5e60 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:35.341913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30cdcf-3296-4fc5-ba3e-7ba3a2d437d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:35.344148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30cdcf-3296-4fc5-ba3e-7ba3a2d437d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:35.345161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30cdcf-3296-4fc5-ba3e-7ba3a2d437d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:35.345656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30cdcf-3296-4fc5-ba3e-7ba3a2d437d4 admin admin] PATH_INFO: `/v3/projects/5e0815654ada4350b365f8d574bebb2e/users/a3c4e1a5e9614448b31be7823d9b65bb/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:35.347989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30cdcf-3296-4fc5-ba3e-7ba3a2d437d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0815654ada4350b365f8d574bebb2e, user_id=a3c4e1a5e9614448b31be7823d9b65bb, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:35.351914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30cdcf-3296-4fc5-ba3e-7ba3a2d437d4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:35.373334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1075/2156] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:35 2022] PUT /identity/v3/projects/5e0815654ada4350b365f8d574bebb2e/users/a3c4e1a5e9614448b31be7823d9b65bb/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:36.394462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c992e-3ae0-4548-89ef-ce5a664f584f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:36.398128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-667c992e-3ae0-4548-89ef-ce5a664f584f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:36.432767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c992e-3ae0-4548-89ef-ce5a664f584f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:36.561740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:36.578966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:36.579920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:36.580434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] PATH_INFO: `/v3/users/81ec46005396450f919bfb7dd85c42c5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:36.583432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ec46005396450f919bfb7dd85c42c5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:36.588913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:36.700933 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ec46005396450f919bfb7dd85c42c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:36.701825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ec46005396450f919bfb7dd85c42c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:36.703631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ec46005396450f919bfb7dd85c42c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:36.724719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ec46005396450f919bfb7dd85c42c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:36.760929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ec46005396450f919bfb7dd85c42c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:36.813947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1082/2157] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:36 2022] DELETE /identity/v3/users/81ec46005396450f919bfb7dd85c42c5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:36.816777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d21a3-fabe-49ea-b3e5-e1a399993206 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:36.817583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d21a3-fabe-49ea-b3e5-e1a399993206 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:36.817583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d21a3-fabe-49ea-b3e5-e1a399993206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:36.859337 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e42d21a3-fabe-49ea-b3e5-e1a399993206 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:36.860813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e42d21a3-fabe-49ea-b3e5-e1a399993206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:37.029005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1076/2158] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:37.083117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:37.084872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:37.209704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c1948-ca94-4c14-8c71-41b54965016c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:37.229855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c91f1-c621-4371-be31-e7350e0b8c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:37.230852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c91f1-c621-4371-be31-e7350e0b8c90 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:37.231240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c91f1-c621-4371-be31-e7350e0b8c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:37.231620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c91f1-c621-4371-be31-e7350e0b8c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:37.263419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:37.283126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c91f1-c621-4371-be31-e7350e0b8c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:37.285185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c91f1-c621-4371-be31-e7350e0b8c90 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:37.325324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1083/2159] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:39.018896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d21a3-fabe-49ea-b3e5-e1a399993206 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:39.021404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e42d21a3-fabe-49ea-b3e5-e1a399993206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:39.040458 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d21a3-fabe-49ea-b3e5-e1a399993206 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:39.051104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:39.052044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:39.055622 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:39.056200 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] PATH_INFO: `/v3/projects/d38fe034c4c24983a928840dd12c3c75` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:39.059063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38fe034c4c24983a928840dd12c3c75)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:39.061825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:39.202809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38fe034c4c24983a928840dd12c3c75', 'request_id': 'req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.209418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:39.212285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38fe034c4c24983a928840dd12c3c75', 'request_id': 'req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.257198 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38fe034c4c24983a928840dd12c3c75', 'request_id': 'req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.301401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] The token cache is being invalidate because project d38fe034c4c24983a928840dd12c3c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:39.301703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.302767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-166fc8fc-c0b6-49bb-bdde-46605f4b69f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.307066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1077/2160] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:39 2022] DELETE /identity/v3/projects/d38fe034c4c24983a928840dd12c3c75 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:39.329658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c91f1-c621-4371-be31-e7350e0b8c90 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:39.357507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c91f1-c621-4371-be31-e7350e0b8c90 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:39.596360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:39.597718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:39.598130 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:39.598508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] PATH_INFO: `/v3/users/55fd2bb2ab074294b45edad8a7f6a39c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:39.600134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fd2bb2ab074294b45edad8a7f6a39c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:39.602389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:39.699889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fd2bb2ab074294b45edad8a7f6a39c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.701463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fd2bb2ab074294b45edad8a7f6a39c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.710136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fd2bb2ab074294b45edad8a7f6a39c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.735494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fd2bb2ab074294b45edad8a7f6a39c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.764153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fd2bb2ab074294b45edad8a7f6a39c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:39.805865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1084/2161] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:39 2022] DELETE /identity/v3/users/55fd2bb2ab074294b45edad8a7f6a39c => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:40.262533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee469b8-4f37-41d6-8b66-53a8de00a529 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:40.263588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee469b8-4f37-41d6-8b66-53a8de00a529 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:40.264076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee469b8-4f37-41d6-8b66-53a8de00a529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:40.353192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fee469b8-4f37-41d6-8b66-53a8de00a529 None None] MFA Rules not processed for user `a3c4e1a5e9614448b31be7823d9b65bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:40.354870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fee469b8-4f37-41d6-8b66-53a8de00a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:40.619853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1078/2162] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:40.651281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:40.687231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:40.861787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8458d-cbbb-4221-993b-78867b7620e4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:40.881873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf26bc5-0b7f-4e17-9d13-6baabeb622da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:40.882943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf26bc5-0b7f-4e17-9d13-6baabeb622da service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:40.883495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf26bc5-0b7f-4e17-9d13-6baabeb622da service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:40.883948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf26bc5-0b7f-4e17-9d13-6baabeb622da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:40.886302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-caf26bc5-0b7f-4e17-9d13-6baabeb622da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:40.973446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:41.047515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf26bc5-0b7f-4e17-9d13-6baabeb622da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:41.051316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf26bc5-0b7f-4e17-9d13-6baabeb622da service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:41.086635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1085/2163] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:41.450257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee469b8-4f37-41d6-8b66-53a8de00a529 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:41.453468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fee469b8-4f37-41d6-8b66-53a8de00a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:41.618359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee469b8-4f37-41d6-8b66-53a8de00a529 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:41.623698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:41.624682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:41.625403 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:41.625919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] PATH_INFO: `/v3/projects/15b5584a3b9a4691aa1a2a7374f82e65` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:41.628600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b5584a3b9a4691aa1a2a7374f82e65)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:41.631241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:41.751171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b5584a3b9a4691aa1a2a7374f82e65', 'request_id': 'req-edd24ad7-af55-4331-9165-c03d5a4d50ba'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:41.769637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b5584a3b9a4691aa1a2a7374f82e65', 'request_id': 'req-edd24ad7-af55-4331-9165-c03d5a4d50ba'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:41.783358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b5584a3b9a4691aa1a2a7374f82e65', 'request_id': 'req-edd24ad7-af55-4331-9165-c03d5a4d50ba'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:41.808281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:41.830796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] The token cache is being invalidate because project 15b5584a3b9a4691aa1a2a7374f82e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:41.831123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:41.832560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:41.834750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1079/2164] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:41 2022] DELETE /identity/v3/projects/15b5584a3b9a4691aa1a2a7374f82e65 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:41.839433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf26bc5-0b7f-4e17-9d13-6baabeb622da service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:41.868277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf26bc5-0b7f-4e17-9d13-6baabeb622da service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:41.996903 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:41.997787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:41.998080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:41.998389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] PATH_INFO: `/v3/users/dbbd1f0181064a39bc44c9b9c5d1742c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:42.000106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbbd1f0181064a39bc44c9b9c5d1742c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:42.002723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:42.059124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbbd1f0181064a39bc44c9b9c5d1742c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.061630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbbd1f0181064a39bc44c9b9c5d1742c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.062299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbbd1f0181064a39bc44c9b9c5d1742c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.072301 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbbd1f0181064a39bc44c9b9c5d1742c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.084671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbbd1f0181064a39bc44c9b9c5d1742c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.111594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1086/2165] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:58:41 2022] DELETE /identity/v3/users/dbbd1f0181064a39bc44c9b9c5d1742c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:42.546441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:42.549798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:42.611374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd24ad7-af55-4331-9165-c03d5a4d50ba admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:42.774476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:42.775389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:42.775678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:42.775970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] PATH_INFO: `/v3/projects/8e953230e5b8435181d6c627c96231bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:42.778122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e953230e5b8435181d6c627c96231bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:42.780156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:42.895364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e953230e5b8435181d6c627c96231bd', 'request_id': 'req-e9f85772-a24c-4c3a-9773-455c3f7f05ef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.919302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e953230e5b8435181d6c627c96231bd', 'request_id': 'req-e9f85772-a24c-4c3a-9773-455c3f7f05ef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.925364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e953230e5b8435181d6c627c96231bd', 'request_id': 'req-e9f85772-a24c-4c3a-9773-455c3f7f05ef'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.935918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:42.937767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:42.959639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] The token cache is being invalidate because project 8e953230e5b8435181d6c627c96231bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:58:42.960153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.961210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e9f85772-a24c-4c3a-9773-455c3f7f05ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:58:42.963079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1080/2166] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:58:42 2022] DELETE /identity/v3/projects/8e953230e5b8435181d6c627c96231bd => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:42.971029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35da7-db22-45d2-a6ff-80b4068b7440 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:42.971416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35da7-db22-45d2-a6ff-80b4068b7440 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:42.971780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35da7-db22-45d2-a6ff-80b4068b7440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:42.997075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-57c35da7-db22-45d2-a6ff-80b4068b7440 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:42.999223 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-57c35da7-db22-45d2-a6ff-80b4068b7440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:43.046860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:43.054995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a83a7e-465f-40e9-be3c-17e433f516b0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:43.106594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1081/2167] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:43.121258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9027f-2fe0-42bd-a2d0-74bf554ab0f6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:43.121258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9027f-2fe0-42bd-a2d0-74bf554ab0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:43.121258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9027f-2fe0-42bd-a2d0-74bf554ab0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:43.146106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190dfb5-8ccb-4072-b413-aec8be5ad6cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:43.146896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190dfb5-8ccb-4072-b413-aec8be5ad6cd service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:43.147251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190dfb5-8ccb-4072-b413-aec8be5ad6cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:43.147715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190dfb5-8ccb-4072-b413-aec8be5ad6cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:43.150754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0190dfb5-8ccb-4072-b413-aec8be5ad6cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:43.158138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-aef9027f-2fe0-42bd-a2d0-74bf554ab0f6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:43.160983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aef9027f-2fe0-42bd-a2d0-74bf554ab0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:43.179053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1082/2168] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:43.182319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9027f-2fe0-42bd-a2d0-74bf554ab0f6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:43.200388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9027f-2fe0-42bd-a2d0-74bf554ab0f6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:43.216688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee3fc4-b334-4373-8d84-2994aaadf268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:43.217069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee3fc4-b334-4373-8d84-2994aaadf268 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:43.217348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee3fc4-b334-4373-8d84-2994aaadf268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:43.217635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee3fc4-b334-4373-8d84-2994aaadf268 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:43.218431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee3fc4-b334-4373-8d84-2994aaadf268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:58:43.218746 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee3fc4-b334-4373-8d84-2994aaadf268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:43.220564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee3fc4-b334-4373-8d84-2994aaadf268 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:43.244252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1083/2169] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:58:43.253546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee3fc4-b334-4373-8d84-2994aaadf268 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:43.266314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee3fc4-b334-4373-8d84-2994aaadf268 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:43.272086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a16f4b-5135-4339-a21c-b7de7f48ff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:43.272957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16f4b-5135-4339-a21c-b7de7f48ff00 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:43.273257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16f4b-5135-4339-a21c-b7de7f48ff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:43.273603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16f4b-5135-4339-a21c-b7de7f48ff00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:43.274579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a16f4b-5135-4339-a21c-b7de7f48ff00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:43.276876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a16f4b-5135-4339-a21c-b7de7f48ff00 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:43.283454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:43.284144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190dfb5-8ccb-4072-b413-aec8be5ad6cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:43.285969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190dfb5-8ccb-4072-b413-aec8be5ad6cd service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:43.301671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1087/2170] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:58:43.357205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1084/2171] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:43 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:43.358419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190dfb5-8ccb-4072-b413-aec8be5ad6cd service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:43.370784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190dfb5-8ccb-4072-b413-aec8be5ad6cd service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:43.479530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378158e-4bab-404c-9c05-89b01b48f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:43.482279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378158e-4bab-404c-9c05-89b01b48f855 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:43.482279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378158e-4bab-404c-9c05-89b01b48f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:43.482456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378158e-4bab-404c-9c05-89b01b48f855 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:43.483212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378158e-4bab-404c-9c05-89b01b48f855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:43.490745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378158e-4bab-404c-9c05-89b01b48f855 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:43.527659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1088/2172] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:43 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:58:43.533063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a16f4b-5135-4339-a21c-b7de7f48ff00 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:43.550927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a16f4b-5135-4339-a21c-b7de7f48ff00 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:43.557777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5becd7-124f-403c-883c-ae5af4e0a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:43.558693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5becd7-124f-403c-883c-ae5af4e0a214 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:43.559082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5becd7-124f-403c-883c-ae5af4e0a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:43.559461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5becd7-124f-403c-883c-ae5af4e0a214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:43.560320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5becd7-124f-403c-883c-ae5af4e0a214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:43.562194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5becd7-124f-403c-883c-ae5af4e0a214 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:43.575328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1085/2173] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:58:43.580606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378158e-4bab-404c-9c05-89b01b48f855 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:43.603221 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378158e-4bab-404c-9c05-89b01b48f855 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:43.609688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12909-5023-48eb-aad3-20ff2eed795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:43.609688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12909-5023-48eb-aad3-20ff2eed795a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:43.609688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12909-5023-48eb-aad3-20ff2eed795a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:43.609688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12909-5023-48eb-aad3-20ff2eed795a admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:43.610475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff12909-5023-48eb-aad3-20ff2eed795a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:43.612201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff12909-5023-48eb-aad3-20ff2eed795a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:43.625102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1089/2174] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:43.630492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5becd7-124f-403c-883c-ae5af4e0a214 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:43.646694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5becd7-124f-403c-883c-ae5af4e0a214 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:43.656339 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ebd1-a3e9-4fa5-b803-6379cfac6cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:43.657649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ebd1-a3e9-4fa5-b803-6379cfac6cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:43.657933 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ebd1-a3e9-4fa5-b803-6379cfac6cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:43.658333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ebd1-a3e9-4fa5-b803-6379cfac6cfc admin admin] PATH_INFO: `/v3/projects/f1550404a68e4cce9bd00dcc35468aa5/users/6c5ede9627064325b69ab0fccf2d9dc6/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:43.690532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77ebd1-a3e9-4fa5-b803-6379cfac6cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1550404a68e4cce9bd00dcc35468aa5, user_id=6c5ede9627064325b69ab0fccf2d9dc6, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:43.693651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77ebd1-a3e9-4fa5-b803-6379cfac6cfc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:43.718152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1086/2175] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:43 2022] PUT /identity/v3/projects/f1550404a68e4cce9bd00dcc35468aa5/users/6c5ede9627064325b69ab0fccf2d9dc6/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:43.732324 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238730-b291-4d36-993a-040a731badd4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:43.732836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238730-b291-4d36-993a-040a731badd4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:43.733326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238730-b291-4d36-993a-040a731badd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:43.786317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-19238730-b291-4d36-993a-040a731badd4 None None] MFA Rules not processed for user `6c5ede9627064325b69ab0fccf2d9dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:43.786317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-19238730-b291-4d36-993a-040a731badd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:43.829631 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:43.942328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1090/2176] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:43.954433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ebd1-a3e9-4fa5-b803-6379cfac6cfc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:43.956839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4f77ebd1-a3e9-4fa5-b803-6379cfac6cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:44.065236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ebd1-a3e9-4fa5-b803-6379cfac6cfc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:44.073085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea2458-678a-4a94-81e2-2c1fa81b3091 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984780a6a8df405dbbb2ba4c46dd841c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:44.074144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2458-678a-4a94-81e2-2c1fa81b3091 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:44.075412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2458-678a-4a94-81e2-2c1fa81b3091 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:44.075860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2458-678a-4a94-81e2-2c1fa81b3091 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:44.099382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea2458-678a-4a94-81e2-2c1fa81b3091 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:44.102708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea2458-678a-4a94-81e2-2c1fa81b3091 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:44.119921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1087/2177] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:58:44.666164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acdbd3-890e-46f6-bacf-48ed72365b50 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:44.666471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acdbd3-890e-46f6-bacf-48ed72365b50 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:44.666979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acdbd3-890e-46f6-bacf-48ed72365b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:44.709331 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-01acdbd3-890e-46f6-bacf-48ed72365b50 None None] MFA Rules not processed for user `18195083037046bd99166f68690c3dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:44.711932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-01acdbd3-890e-46f6-bacf-48ed72365b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:44.923803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1091/2178] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:58:44.929629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea2458-678a-4a94-81e2-2c1fa81b3091 service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:44.932454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2cea2458-678a-4a94-81e2-2c1fa81b3091 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:45.139767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea2458-678a-4a94-81e2-2c1fa81b3091 service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:45.150870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05e23b-d993-4242-8b6f-a62255f493ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:45.152275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05e23b-d993-4242-8b6f-a62255f493ba admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:45.153296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05e23b-d993-4242-8b6f-a62255f493ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:45.153850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05e23b-d993-4242-8b6f-a62255f493ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:45.155062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05e23b-d993-4242-8b6f-a62255f493ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:45.159029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05e23b-d993-4242-8b6f-a62255f493ba admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:45.205927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1088/2179] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:58:44 2022] POST /identity/v3/projects => generated 379 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:45.212039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acdbd3-890e-46f6-bacf-48ed72365b50 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:45.226522 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acdbd3-890e-46f6-bacf-48ed72365b50 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:45.306233 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1994-c2cf-4f54-848e-134629bbcd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:45.307079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1994-c2cf-4f54-848e-134629bbcd24 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:45.307205 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1994-c2cf-4f54-848e-134629bbcd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:45.307485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1994-c2cf-4f54-848e-134629bbcd24 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:45.308230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd1994-c2cf-4f54-848e-134629bbcd24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:45.310297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd1994-c2cf-4f54-848e-134629bbcd24 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:45.336691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1092/2180] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:58:45 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:58:45.341139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05e23b-d993-4242-8b6f-a62255f493ba admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:45.362024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05e23b-d993-4242-8b6f-a62255f493ba admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:45.369725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbc0c3-5c03-406a-8d50-cb107ff366a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:45.370599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbc0c3-5c03-406a-8d50-cb107ff366a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:45.370994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbc0c3-5c03-406a-8d50-cb107ff366a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:45.371342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbc0c3-5c03-406a-8d50-cb107ff366a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:45.372563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbc0c3-5c03-406a-8d50-cb107ff366a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:45.375308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbc0c3-5c03-406a-8d50-cb107ff366a5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:45.398828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1089/2181] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:45.405438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1994-c2cf-4f54-848e-134629bbcd24 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:45.422234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1994-c2cf-4f54-848e-134629bbcd24 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:45.428634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e6495-6a53-4f25-80a7-42fb2495390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:45.429659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e6495-6a53-4f25-80a7-42fb2495390a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:45.439999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e6495-6a53-4f25-80a7-42fb2495390a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:45.439999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e6495-6a53-4f25-80a7-42fb2495390a admin admin] PATH_INFO: `/v3/projects/5f6d8de1913b42cdb1bb37da5c48716b/users/2f7cdf18ba2b4dc4a6cbf1be375071c1/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:45.460607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e6495-6a53-4f25-80a7-42fb2495390a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6d8de1913b42cdb1bb37da5c48716b, user_id=2f7cdf18ba2b4dc4a6cbf1be375071c1, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:45.465833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e6495-6a53-4f25-80a7-42fb2495390a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:45.488754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1093/2182] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:45 2022] PUT /identity/v3/projects/5f6d8de1913b42cdb1bb37da5c48716b/users/2f7cdf18ba2b4dc4a6cbf1be375071c1/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:45.493760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbc0c3-5c03-406a-8d50-cb107ff366a5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:45.509685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbc0c3-5c03-406a-8d50-cb107ff366a5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:45.545079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:45.585822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c7fbc-e20d-447f-84ed-037dc66ab1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:45.586788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7fbc-e20d-447f-84ed-037dc66ab1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:45.587168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7fbc-e20d-447f-84ed-037dc66ab1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:45.587298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7fbc-e20d-447f-84ed-037dc66ab1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:45.588050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c7fbc-e20d-447f-84ed-037dc66ab1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:45.589739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c7fbc-e20d-447f-84ed-037dc66ab1b9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:45.601533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1090/2183] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:58:45.605853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e6495-6a53-4f25-80a7-42fb2495390a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:45.618917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e6495-6a53-4f25-80a7-42fb2495390a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:45.626828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee3c7c-b82c-4054-b761-8f44578eb40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:45.627985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee3c7c-b82c-4054-b761-8f44578eb40b admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:45.628268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee3c7c-b82c-4054-b761-8f44578eb40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:45.628629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee3c7c-b82c-4054-b761-8f44578eb40b admin admin] PATH_INFO: `/v3/projects/5f6d8de1913b42cdb1bb37da5c48716b/users/2f7cdf18ba2b4dc4a6cbf1be375071c1/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:45.630600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee3c7c-b82c-4054-b761-8f44578eb40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6d8de1913b42cdb1bb37da5c48716b, user_id=2f7cdf18ba2b4dc4a6cbf1be375071c1, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:45.633384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee3c7c-b82c-4054-b761-8f44578eb40b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:45.646830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1094/2184] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:58:45 2022] PUT /identity/v3/projects/5f6d8de1913b42cdb1bb37da5c48716b/users/2f7cdf18ba2b4dc4a6cbf1be375071c1/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:58:53.295776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f43070-6ba6-42ff-8197-9e289b37457c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:53.296369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f43070-6ba6-42ff-8197-9e289b37457c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:53.296489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f43070-6ba6-42ff-8197-9e289b37457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:53.355883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f4f43070-6ba6-42ff-8197-9e289b37457c None None] MFA Rules not processed for user `2f7cdf18ba2b4dc4a6cbf1be375071c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:58:53.364361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f4f43070-6ba6-42ff-8197-9e289b37457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:53.529206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1091/2185] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:58:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:58:53.548842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee3c7c-b82c-4054-b761-8f44578eb40b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:58:53.551585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1dee3c7c-b82c-4054-b761-8f44578eb40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:58:53.569273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:58:53.752362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee3c7c-b82c-4054-b761-8f44578eb40b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:58:53.760568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc2fd5-a5b2-40ed-b03f-c3dca9425676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:58:53.761257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc2fd5-a5b2-40ed-b03f-c3dca9425676 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:58:53.761672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc2fd5-a5b2-40ed-b03f-c3dca9425676 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:58:53.761984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc2fd5-a5b2-40ed-b03f-c3dca9425676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:58:53.844632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc2fd5-a5b2-40ed-b03f-c3dca9425676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:58:53.846560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc2fd5-a5b2-40ed-b03f-c3dca9425676 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:58:53.858714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1095/2186] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:58:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 12:59:02.461497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef140-baa0-45d6-b8a2-9b747c98eabc None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:02.462175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef140-baa0-45d6-b8a2-9b747c98eabc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:02.462175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef140-baa0-45d6-b8a2-9b747c98eabc None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:02.463529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1092/2187] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 12:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 12:59:02.738207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f67c5-e2aa-4930-85c5-2deccacdc327 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:02.738876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f67c5-e2aa-4930-85c5-2deccacdc327 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:02.738876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f67c5-e2aa-4930-85c5-2deccacdc327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:02.801625 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-465f67c5-e2aa-4930-85c5-2deccacdc327 None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:02.804516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-465f67c5-e2aa-4930-85c5-2deccacdc327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:02.957486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1096/2188] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 12:59:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:02.985361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fef140-baa0-45d6-b8a2-9b747c98eabc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:02.988204 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b7fef140-baa0-45d6-b8a2-9b747c98eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:03.014701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f67c5-e2aa-4930-85c5-2deccacdc327 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:03.017339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-465f67c5-e2aa-4930-85c5-2deccacdc327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:03.031947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f67c5-e2aa-4930-85c5-2deccacdc327 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:03.047460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa5cbf-3e3f-47b8-9f6a-5450040af7af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:03.048158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa5cbf-3e3f-47b8-9f6a-5450040af7af service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:03.048446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa5cbf-3e3f-47b8-9f6a-5450040af7af service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:03.048725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa5cbf-3e3f-47b8-9f6a-5450040af7af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:03.059596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa5cbf-3e3f-47b8-9f6a-5450040af7af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:03.061686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa5cbf-3e3f-47b8-9f6a-5450040af7af service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:03.075262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1097/2189] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:59:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:59:03.116212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fef140-baa0-45d6-b8a2-9b747c98eabc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:03.128244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:03.129776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:03.130071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:03.130413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] PATH_INFO: `/v3/users/e2d0edf9b51d4370950f7ff503c324b8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:03.132433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d0edf9b51d4370950f7ff503c324b8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:03.135527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:03.246712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d0edf9b51d4370950f7ff503c324b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.258602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:03.273087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d0edf9b51d4370950f7ff503c324b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.274604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d0edf9b51d4370950f7ff503c324b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.287472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d0edf9b51d4370950f7ff503c324b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.299449 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-231d6cc9-63df-4754-8ee5-02bc08311128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d0edf9b51d4370950f7ff503c324b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.326250 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1093/2190] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:59:02 2022] DELETE /identity/v3/users/e2d0edf9b51d4370950f7ff503c324b8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:03.569605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa5cbf-3e3f-47b8-9f6a-5450040af7af service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:03.581852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa5cbf-3e3f-47b8-9f6a-5450040af7af service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:03.607889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:03.682840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:03.683853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:03.684230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:03.685283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] PATH_INFO: `/v3/projects/4c048fb2cf4e491980fb65a8e32b0fb2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:03.686706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c048fb2cf4e491980fb65a8e32b0fb2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:03.688863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:03.759235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c048fb2cf4e491980fb65a8e32b0fb2', 'request_id': 'req-658fa705-6fb5-41ac-b582-e36a4736c2db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.766358 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c048fb2cf4e491980fb65a8e32b0fb2', 'request_id': 'req-658fa705-6fb5-41ac-b582-e36a4736c2db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.780941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c048fb2cf4e491980fb65a8e32b0fb2', 'request_id': 'req-658fa705-6fb5-41ac-b582-e36a4736c2db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.803703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] The token cache is being invalidate because project 4c048fb2cf4e491980fb65a8e32b0fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:59:03.804131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.805158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-658fa705-6fb5-41ac-b582-e36a4736c2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:03.807465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1098/2191] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:59:03 2022] DELETE /identity/v3/projects/4c048fb2cf4e491980fb65a8e32b0fb2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:59:03.813466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dee778-c5e0-42e6-9a56-066f8c551261 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:03.814068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dee778-c5e0-42e6-9a56-066f8c551261 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:03.814068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dee778-c5e0-42e6-9a56-066f8c551261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:03.835571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-49dee778-c5e0-42e6-9a56-066f8c551261 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:03.837018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-49dee778-c5e0-42e6-9a56-066f8c551261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:03.917881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1094/2192] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:03.928838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733967a-2373-49cb-9fd6-53197fe4dcb2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:03.929439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733967a-2373-49cb-9fd6-53197fe4dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:03.929875 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733967a-2373-49cb-9fd6-53197fe4dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:03.951612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d733967a-2373-49cb-9fd6-53197fe4dcb2 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:03.952915 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d733967a-2373-49cb-9fd6-53197fe4dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:03.962141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1099/2193] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:59:03.966883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dee778-c5e0-42e6-9a56-066f8c551261 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:03.977533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dee778-c5e0-42e6-9a56-066f8c551261 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:03.982403 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:03.983103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:03.983584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:03.984139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:03.984895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:59:03.985365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:03.987152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.008284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1095/2194] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:59:04.016202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733967a-2373-49cb-9fd6-53197fe4dcb2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:04.023802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:04.025864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:04.034686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733967a-2373-49cb-9fd6-53197fe4dcb2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:04.042666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34b4c-4af1-4c80-9165-a45252c9742a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:04.046150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668074f7-42d2-40a1-95e0-7ccfebbd708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:04.046900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668074f7-42d2-40a1-95e0-7ccfebbd708f admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.047217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668074f7-42d2-40a1-95e0-7ccfebbd708f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.047526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668074f7-42d2-40a1-95e0-7ccfebbd708f admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.047727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:04.048309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668074f7-42d2-40a1-95e0-7ccfebbd708f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:04.048504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.048741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.049021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] PATH_INFO: `/v3/users/5a484edbf1c341c4b772dab0f1597694` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.050626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a484edbf1c341c4b772dab0f1597694)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:04.051214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668074f7-42d2-40a1-95e0-7ccfebbd708f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.052375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.090820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1100/2195] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:59:04 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:59:04.095025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668074f7-42d2-40a1-95e0-7ccfebbd708f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:04.110279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a484edbf1c341c4b772dab0f1597694'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.131005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a484edbf1c341c4b772dab0f1597694'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.131659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a484edbf1c341c4b772dab0f1597694'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.142321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a484edbf1c341c4b772dab0f1597694'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.152421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a484edbf1c341c4b772dab0f1597694'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.161749 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1096/2196] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:59:04 2022] DELETE /identity/v3/users/5a484edbf1c341c4b772dab0f1597694 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:04.172454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668074f7-42d2-40a1-95e0-7ccfebbd708f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:04.222966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:04.295122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede142d-f6c0-4b58-8941-29c8c92946c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:04.295917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede142d-f6c0-4b58-8941-29c8c92946c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.296276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede142d-f6c0-4b58-8941-29c8c92946c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.296623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede142d-f6c0-4b58-8941-29c8c92946c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.297531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede142d-f6c0-4b58-8941-29c8c92946c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:04.299807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede142d-f6c0-4b58-8941-29c8c92946c1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.342127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1101/2197] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:59:04 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:59:04.346264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:04.348153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:04.361962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9d8a1-b359-4eaa-b312-77df20fa2dfc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:04.367364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04388a1a-a766-4451-99c0-d55c5c2014d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:04.368923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04388a1a-a766-4451-99c0-d55c5c2014d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.368923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04388a1a-a766-4451-99c0-d55c5c2014d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.368923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04388a1a-a766-4451-99c0-d55c5c2014d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.369569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04388a1a-a766-4451-99c0-d55c5c2014d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:04.371525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04388a1a-a766-4451-99c0-d55c5c2014d8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.388906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1097/2198] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:59:04.397799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede142d-f6c0-4b58-8941-29c8c92946c1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:04.409624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede142d-f6c0-4b58-8941-29c8c92946c1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:04.415627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b3137-570f-46a0-b874-f63483465898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:04.416405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3137-570f-46a0-b874-f63483465898 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.416682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3137-570f-46a0-b874-f63483465898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.416962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3137-570f-46a0-b874-f63483465898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.417834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b3137-570f-46a0-b874-f63483465898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:04.422163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b3137-570f-46a0-b874-f63483465898 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.423019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04388a1a-a766-4451-99c0-d55c5c2014d8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:04.424932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-04388a1a-a766-4451-99c0-d55c5c2014d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:04.433954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1102/2199] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:59:04.438610 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b3137-570f-46a0-b874-f63483465898 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:04.444632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04388a1a-a766-4451-99c0-d55c5c2014d8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:04.450062 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:04.450971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b3137-570f-46a0-b874-f63483465898 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:04.451141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.451515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.451843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] PATH_INFO: `/v3/projects/9140bf138ea54c079231b49535a4995e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.453133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9140bf138ea54c079231b49535a4995e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:04.455521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.458282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce829-9693-4045-9e84-1710b58746ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:04.459455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce829-9693-4045-9e84-1710b58746ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.459806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce829-9693-4045-9e84-1710b58746ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.460409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce829-9693-4045-9e84-1710b58746ce admin admin] PATH_INFO: `/v3/projects/dfd5f42fc8374fae92906a128181ad69/users/6e0fa033a9db4ef5b125dbb77eb8b29b/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.471391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:04.481532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce829-9693-4045-9e84-1710b58746ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd5f42fc8374fae92906a128181ad69, user_id=6e0fa033a9db4ef5b125dbb77eb8b29b, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:04.484375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce829-9693-4045-9e84-1710b58746ce admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.503612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1103/2200] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:59:04 2022] PUT /identity/v3/projects/dfd5f42fc8374fae92906a128181ad69/users/6e0fa033a9db4ef5b125dbb77eb8b29b/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:59:04.517052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e954-58c4-4c1f-a199-91a9b2de0add None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.517328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e954-58c4-4c1f-a199-91a9b2de0add None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.517612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e954-58c4-4c1f-a199-91a9b2de0add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.532989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9140bf138ea54c079231b49535a4995e', 'request_id': 'req-05beee8f-00bc-42d4-82e2-2699423a0a7f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.540009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9140bf138ea54c079231b49535a4995e', 'request_id': 'req-05beee8f-00bc-42d4-82e2-2699423a0a7f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.547490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9140bf138ea54c079231b49535a4995e', 'request_id': 'req-05beee8f-00bc-42d4-82e2-2699423a0a7f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.552425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3d25e954-58c4-4c1f-a199-91a9b2de0add None None] MFA Rules not processed for user `6e0fa033a9db4ef5b125dbb77eb8b29b`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:04.553700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3d25e954-58c4-4c1f-a199-91a9b2de0add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:04.573099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] The token cache is being invalidate because project 9140bf138ea54c079231b49535a4995e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:59:04.573444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.574243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.576024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1098/2201] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:59:04 2022] DELETE /identity/v3/projects/9140bf138ea54c079231b49535a4995e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:59:04.582975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:04.584532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:04.649989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1104/2202] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:59:04.657987 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25e954-58c4-4c1f-a199-91a9b2de0add None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:04.661903 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3d25e954-58c4-4c1f-a199-91a9b2de0add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:04.695164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beee8f-00bc-42d4-82e2-2699423a0a7f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:04.700550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:04.701702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.702153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.702617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] PATH_INFO: `/v3/users/a3c4e1a5e9614448b31be7823d9b65bb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.711577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c4e1a5e9614448b31be7823d9b65bb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:04.714373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.814904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25e954-58c4-4c1f-a199-91a9b2de0add None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:04.820724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c4e1a5e9614448b31be7823d9b65bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.822485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c1065-5dba-4ced-817b-a74282b0b644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:04.823271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c1065-5dba-4ced-817b-a74282b0b644 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:04.823678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c1065-5dba-4ced-817b-a74282b0b644 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:04.824116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c1065-5dba-4ced-817b-a74282b0b644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:04.837985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c4e1a5e9614448b31be7823d9b65bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.838756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c4e1a5e9614448b31be7823d9b65bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.848430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c1065-5dba-4ced-817b-a74282b0b644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:04.849788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c4e1a5e9614448b31be7823d9b65bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.850197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c1065-5dba-4ced-817b-a74282b0b644 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:04.858159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:04.867534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56a0c531-e6e4-4021-acba-bed84a3aa229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c4e1a5e9614448b31be7823d9b65bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:04.882452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1105/2203] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:59:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:59:04.885968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1099/2204] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:59:04 2022] DELETE /identity/v3/users/a3c4e1a5e9614448b31be7823d9b65bb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:59:05.149563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c1065-5dba-4ced-817b-a74282b0b644 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:05.162374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c1065-5dba-4ced-817b-a74282b0b644 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:05.272512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:05.277992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.278326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.278664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] PATH_INFO: `/v3/projects/5e0815654ada4350b365f8d574bebb2e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:05.280568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0815654ada4350b365f8d574bebb2e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:05.283152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:05.354492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0815654ada4350b365f8d574bebb2e', 'request_id': 'req-7e7efe12-ee12-4865-961a-b54f1acddc65'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:05.364161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0815654ada4350b365f8d574bebb2e', 'request_id': 'req-7e7efe12-ee12-4865-961a-b54f1acddc65'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:05.378080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0815654ada4350b365f8d574bebb2e', 'request_id': 'req-7e7efe12-ee12-4865-961a-b54f1acddc65'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:05.408880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] The token cache is being invalidate because project 5e0815654ada4350b365f8d574bebb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:59:05.409468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:05.410315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e7efe12-ee12-4865-961a-b54f1acddc65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:05.414555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1106/2205] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:59:05 2022] DELETE /identity/v3/projects/5e0815654ada4350b365f8d574bebb2e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:05.424685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bdd2f-9ddf-4f54-a2b0-77d560deb304 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.426660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bdd2f-9ddf-4f54-a2b0-77d560deb304 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.427214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bdd2f-9ddf-4f54-a2b0-77d560deb304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:05.463356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-915bdd2f-9ddf-4f54-a2b0-77d560deb304 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:05.464951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-915bdd2f-9ddf-4f54-a2b0-77d560deb304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:05.486165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:05.543256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1100/2206] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:05.557596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979bea2-e092-44ab-89d8-5891495a8529 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.557948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979bea2-e092-44ab-89d8-5891495a8529 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.558184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979bea2-e092-44ab-89d8-5891495a8529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:05.578422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d979bea2-e092-44ab-89d8-5891495a8529 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:05.579870 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d979bea2-e092-44ab-89d8-5891495a8529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:05.588763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1107/2207] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:59:05.593641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bdd2f-9ddf-4f54-a2b0-77d560deb304 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:05.604691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bdd2f-9ddf-4f54-a2b0-77d560deb304 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:05.609794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4c319-93b4-44a0-bf50-42ee4715d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:05.610597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c319-93b4-44a0-bf50-42ee4715d68c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.610878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c319-93b4-44a0-bf50-42ee4715d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.611157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c319-93b4-44a0-bf50-42ee4715d68c admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:05.611943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4c319-93b4-44a0-bf50-42ee4715d68c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:59:05.612242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4c319-93b4-44a0-bf50-42ee4715d68c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:05.614021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4c319-93b4-44a0-bf50-42ee4715d68c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:05.627993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1101/2208] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:59:05.633002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979bea2-e092-44ab-89d8-5891495a8529 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:05.643757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979bea2-e092-44ab-89d8-5891495a8529 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:05.649088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c83d7a-2633-4fed-b314-9657fbfec6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:05.649806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c83d7a-2633-4fed-b314-9657fbfec6df admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.650111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c83d7a-2633-4fed-b314-9657fbfec6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.650381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c83d7a-2633-4fed-b314-9657fbfec6df admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:05.651084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c83d7a-2633-4fed-b314-9657fbfec6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:05.653067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c83d7a-2633-4fed-b314-9657fbfec6df admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:05.682907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1108/2209] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:59:05 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:59:05.687694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4c319-93b4-44a0-bf50-42ee4715d68c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:05.699229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4c319-93b4-44a0-bf50-42ee4715d68c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:05.766846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2344-9f34-43d1-a273-ccaf3929a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:05.767627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2344-9f34-43d1-a273-ccaf3929a829 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.768017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2344-9f34-43d1-a273-ccaf3929a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.768348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2344-9f34-43d1-a273-ccaf3929a829 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:05.769470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c2344-9f34-43d1-a273-ccaf3929a829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:05.771572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c2344-9f34-43d1-a273-ccaf3929a829 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:05.799833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1102/2210] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:59:05 2022] POST /identity/v3/users => generated 281 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:59:05.804246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c83d7a-2633-4fed-b314-9657fbfec6df admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:05.821786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c83d7a-2633-4fed-b314-9657fbfec6df admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:05.827100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8cec6-9d52-406b-95ba-e965d9abfc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:05.827802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8cec6-9d52-406b-95ba-e965d9abfc48 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.828099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8cec6-9d52-406b-95ba-e965d9abfc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.828368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8cec6-9d52-406b-95ba-e965d9abfc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:05.829106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8cec6-9d52-406b-95ba-e965d9abfc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:05.830995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8cec6-9d52-406b-95ba-e965d9abfc48 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:05.845797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1109/2211] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:59:05.852460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2344-9f34-43d1-a273-ccaf3929a829 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:05.868721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2344-9f34-43d1-a273-ccaf3929a829 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:05.874876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8e4f9-77df-4563-bc86-b9b03daeb6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:05.876028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8e4f9-77df-4563-bc86-b9b03daeb6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.876321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8e4f9-77df-4563-bc86-b9b03daeb6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.876600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8e4f9-77df-4563-bc86-b9b03daeb6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:05.877384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8e4f9-77df-4563-bc86-b9b03daeb6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:05.879394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8e4f9-77df-4563-bc86-b9b03daeb6e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:05.896320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1103/2212] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:59:05.897476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8cec6-9d52-406b-95ba-e965d9abfc48 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:05.911258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8cec6-9d52-406b-95ba-e965d9abfc48 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:05.918711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d0d5f-5ca2-4362-8efc-febcbb9f3d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:05.919644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d0d5f-5ca2-4362-8efc-febcbb9f3d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.919925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d0d5f-5ca2-4362-8efc-febcbb9f3d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.920200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d0d5f-5ca2-4362-8efc-febcbb9f3d33 admin admin] PATH_INFO: `/v3/projects/5f0ea2d461844a75929cbb6d19eba897/users/2e592856f2fb4c42badf86b8622bae39/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:05.937250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d0d5f-5ca2-4362-8efc-febcbb9f3d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0ea2d461844a75929cbb6d19eba897, user_id=2e592856f2fb4c42badf86b8622bae39, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:05.939921 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d0d5f-5ca2-4362-8efc-febcbb9f3d33 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:05.956850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1110/2213] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:59:05 2022] PUT /identity/v3/projects/5f0ea2d461844a75929cbb6d19eba897/users/2e592856f2fb4c42badf86b8622bae39/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:59:05.970016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061326-43cb-485b-bdeb-c29099f917fc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:05.970506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061326-43cb-485b-bdeb-c29099f917fc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:05.980473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061326-43cb-485b-bdeb-c29099f917fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:06.020883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-74061326-43cb-485b-bdeb-c29099f917fc None None] MFA Rules not processed for user `2e592856f2fb4c42badf86b8622bae39`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:06.022182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-74061326-43cb-485b-bdeb-c29099f917fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:06.102438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1104/2214] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:06.158427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d0d5f-5ca2-4362-8efc-febcbb9f3d33 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:06.160523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e60d0d5f-5ca2-4362-8efc-febcbb9f3d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:06.201117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:06.232518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d0d5f-5ca2-4362-8efc-febcbb9f3d33 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:06.236667 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2acb6-8dec-4bcd-9a54-322f559f2813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:06.237665 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2acb6-8dec-4bcd-9a54-322f559f2813 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:06.238056 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2acb6-8dec-4bcd-9a54-322f559f2813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:06.238400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2acb6-8dec-4bcd-9a54-322f559f2813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:06.249583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2acb6-8dec-4bcd-9a54-322f559f2813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:06.252295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2acb6-8dec-4bcd-9a54-322f559f2813 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:06.263209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1111/2215] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:59:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:59:06.283023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74061326-43cb-485b-bdeb-c29099f917fc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:06.306064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:06.367585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74061326-43cb-485b-bdeb-c29099f917fc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:06.376217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:06.377396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:06.377769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:06.378080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] PATH_INFO: `/v3/users/2e592856f2fb4c42badf86b8622bae39` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:06.379993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e592856f2fb4c42badf86b8622bae39)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:06.381975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:06.445791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e592856f2fb4c42badf86b8622bae39'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:06.458953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e592856f2fb4c42badf86b8622bae39'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:06.459621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e592856f2fb4c42badf86b8622bae39'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:06.468413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e592856f2fb4c42badf86b8622bae39'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:06.476788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e592856f2fb4c42badf86b8622bae39'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:06.485346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1105/2216] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:59:06 2022] DELETE /identity/v3/users/2e592856f2fb4c42badf86b8622bae39 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:06.490372 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dec948-a5c1-4571-9b41-7de36633bc77 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:06.490657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dec948-a5c1-4571-9b41-7de36633bc77 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:06.490939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dec948-a5c1-4571-9b41-7de36633bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:06.509936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-47dec948-a5c1-4571-9b41-7de36633bc77 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:06.511630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-47dec948-a5c1-4571-9b41-7de36633bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:06.590620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1112/2217] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:59:06.601346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:06.602809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:06.663177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22539c67-6f67-4689-b3cc-1011b7dd756a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:06.667982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1f13c-341a-4787-b7ba-6a0f794a8e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:06.668678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1f13c-341a-4787-b7ba-6a0f794a8e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:06.668960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1f13c-341a-4787-b7ba-6a0f794a8e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:06.669238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1f13c-341a-4787-b7ba-6a0f794a8e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:06.679828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1f13c-341a-4787-b7ba-6a0f794a8e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:06.681299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1f13c-341a-4787-b7ba-6a0f794a8e15 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:06.691268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1106/2218] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:59:07.012924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dec948-a5c1-4571-9b41-7de36633bc77 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:07.014663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-47dec948-a5c1-4571-9b41-7de36633bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:07.035170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dec948-a5c1-4571-9b41-7de36633bc77 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:07.042961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:07.044183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.044584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.045008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] PATH_INFO: `/v3/projects/5f0ea2d461844a75929cbb6d19eba897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.047008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0ea2d461844a75929cbb6d19eba897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:07.050041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:07.104418 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0ea2d461844a75929cbb6d19eba897', 'request_id': 'req-6effcdf4-49ad-4a7a-85e9-06849f52da70'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:07.115407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0ea2d461844a75929cbb6d19eba897', 'request_id': 'req-6effcdf4-49ad-4a7a-85e9-06849f52da70'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:07.126310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0ea2d461844a75929cbb6d19eba897', 'request_id': 'req-6effcdf4-49ad-4a7a-85e9-06849f52da70'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:07.139697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] The token cache is being invalidate because project 5f0ea2d461844a75929cbb6d19eba897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:59:07.140116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:07.140887 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6effcdf4-49ad-4a7a-85e9-06849f52da70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:07.142585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1113/2219] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:59:07 2022] DELETE /identity/v3/projects/5f0ea2d461844a75929cbb6d19eba897 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:07.149470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcb1f7-835a-4ee8-8d95-4af3ee3689ba None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.150054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcb1f7-835a-4ee8-8d95-4af3ee3689ba None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.150054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebcb1f7-835a-4ee8-8d95-4af3ee3689ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.169820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1ebcb1f7-835a-4ee8-8d95-4af3ee3689ba None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:07.171237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1ebcb1f7-835a-4ee8-8d95-4af3ee3689ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:07.213220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:07.244288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1107/2220] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:07.254641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee396-1f7c-4b5d-89e3-d9e79c2145aa None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.255066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee396-1f7c-4b5d-89e3-d9e79c2145aa None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.255433 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee396-1f7c-4b5d-89e3-d9e79c2145aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.282988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d1bee396-1f7c-4b5d-89e3-d9e79c2145aa None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:07.284525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d1bee396-1f7c-4b5d-89e3-d9e79c2145aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:07.294846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1114/2221] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:07.304305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcb1f7-835a-4ee8-8d95-4af3ee3689ba None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:07.323282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebcb1f7-835a-4ee8-8d95-4af3ee3689ba None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:07.329740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6571c3-74d4-4197-9f7f-34f63e62f79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:07.330650 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6571c3-74d4-4197-9f7f-34f63e62f79a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.331041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6571c3-74d4-4197-9f7f-34f63e62f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.331452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6571c3-74d4-4197-9f7f-34f63e62f79a admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.332587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6571c3-74d4-4197-9f7f-34f63e62f79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:59:07.332899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6571c3-74d4-4197-9f7f-34f63e62f79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:07.334906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6571c3-74d4-4197-9f7f-34f63e62f79a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:07.351766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1108/2222] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 12:59:07.353000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee396-1f7c-4b5d-89e3-d9e79c2145aa None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:07.363988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee396-1f7c-4b5d-89e3-d9e79c2145aa None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:07.368803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6a467-1c65-42c5-b55c-cd489e020965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:07.369481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6a467-1c65-42c5-b55c-cd489e020965 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.369807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6a467-1c65-42c5-b55c-cd489e020965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.370082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6a467-1c65-42c5-b55c-cd489e020965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.370817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6a467-1c65-42c5-b55c-cd489e020965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:07.372783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6a467-1c65-42c5-b55c-cd489e020965 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:07.404072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1115/2223] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:59:07 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:59:07.408507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6571c3-74d4-4197-9f7f-34f63e62f79a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:07.419003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6571c3-74d4-4197-9f7f-34f63e62f79a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:07.499602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a1241-85c2-4394-a330-b8f2647f8fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:07.500798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a1241-85c2-4394-a330-b8f2647f8fff admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.501082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a1241-85c2-4394-a330-b8f2647f8fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.501355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a1241-85c2-4394-a330-b8f2647f8fff admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.502054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a1241-85c2-4394-a330-b8f2647f8fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:07.504070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a1241-85c2-4394-a330-b8f2647f8fff admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:07.526513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1109/2224] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:59:07 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:59:07.530735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6a467-1c65-42c5-b55c-cd489e020965 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:07.541705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6a467-1c65-42c5-b55c-cd489e020965 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:07.547036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc58e38-0393-4fbb-b11b-07b43963bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:07.547697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58e38-0393-4fbb-b11b-07b43963bccb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.547977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58e38-0393-4fbb-b11b-07b43963bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.548245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58e38-0393-4fbb-b11b-07b43963bccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.549212 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc58e38-0393-4fbb-b11b-07b43963bccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:07.550834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc58e38-0393-4fbb-b11b-07b43963bccb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:07.563903 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1116/2225] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:59:07.566621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a1241-85c2-4394-a330-b8f2647f8fff admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:07.577435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a1241-85c2-4394-a330-b8f2647f8fff admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:07.589602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2ee0-a0eb-4c2d-a463-8b291342adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:07.590380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2ee0-a0eb-4c2d-a463-8b291342adc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.590667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2ee0-a0eb-4c2d-a463-8b291342adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.590980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2ee0-a0eb-4c2d-a463-8b291342adc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.591923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a2ee0-a0eb-4c2d-a463-8b291342adc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:07.593653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a2ee0-a0eb-4c2d-a463-8b291342adc8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:07.612938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1110/2226] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:59:07.617388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc58e38-0393-4fbb-b11b-07b43963bccb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:07.628629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc58e38-0393-4fbb-b11b-07b43963bccb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:07.634031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014833-087b-4fac-85b5-77dba9cb44db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:07.635079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014833-087b-4fac-85b5-77dba9cb44db admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.635471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014833-087b-4fac-85b5-77dba9cb44db admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.635778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014833-087b-4fac-85b5-77dba9cb44db admin admin] PATH_INFO: `/v3/projects/b65bd4605d084670bf0a35c1d908e6fe/users/c7ec7651d2ab4f798e898ca6b23ed819/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.649056 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:07.654110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014833-087b-4fac-85b5-77dba9cb44db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65bd4605d084670bf0a35c1d908e6fe, user_id=c7ec7651d2ab4f798e898ca6b23ed819, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:07.657543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014833-087b-4fac-85b5-77dba9cb44db admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:07.675028 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1117/2227] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:59:07 2022] PUT /identity/v3/projects/b65bd4605d084670bf0a35c1d908e6fe/users/c7ec7651d2ab4f798e898ca6b23ed819/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:07.685627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adf7b2-de75-4fa6-940d-c62e143bc5c6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.685951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adf7b2-de75-4fa6-940d-c62e143bc5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.686238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adf7b2-de75-4fa6-940d-c62e143bc5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.716474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-19adf7b2-de75-4fa6-940d-c62e143bc5c6 None None] MFA Rules not processed for user `c7ec7651d2ab4f798e898ca6b23ed819`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:07.717923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-19adf7b2-de75-4fa6-940d-c62e143bc5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:07.789865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1111/2228] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:07.801935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014833-087b-4fac-85b5-77dba9cb44db admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:07.803688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-41014833-087b-4fac-85b5-77dba9cb44db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:07.881453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014833-087b-4fac-85b5-77dba9cb44db admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:07.885308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f704e-aafb-42e9-8e6e-038c252f4476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:07.885975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f704e-aafb-42e9-8e6e-038c252f4476 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:07.886296 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f704e-aafb-42e9-8e6e-038c252f4476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:07.886575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f704e-aafb-42e9-8e6e-038c252f4476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:07.895747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f704e-aafb-42e9-8e6e-038c252f4476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:07.897270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f704e-aafb-42e9-8e6e-038c252f4476 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:07.906921 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1118/2229] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:59:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:59:17.786365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:17.902463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:31.618750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adf7b2-de75-4fa6-940d-c62e143bc5c6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:31.619621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-19adf7b2-de75-4fa6-940d-c62e143bc5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:31.763900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adf7b2-de75-4fa6-940d-c62e143bc5c6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:31.768859 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:31.770776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:31.770776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:31.770776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] PATH_INFO: `/v3/users/6e0fa033a9db4ef5b125dbb77eb8b29b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:31.771625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0fa033a9db4ef5b125dbb77eb8b29b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:31.773678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:31.828502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0fa033a9db4ef5b125dbb77eb8b29b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:31.843811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0fa033a9db4ef5b125dbb77eb8b29b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:31.844599 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0fa033a9db4ef5b125dbb77eb8b29b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:31.854313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0fa033a9db4ef5b125dbb77eb8b29b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:31.861843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0fa033a9db4ef5b125dbb77eb8b29b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:31.869064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1112/2230] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 12:59:31 2022] DELETE /identity/v3/users/6e0fa033a9db4ef5b125dbb77eb8b29b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 12:59:31.873816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63e66-ff96-4375-bd38-03bd8e33fbd3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:31.874395 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63e66-ff96-4375-bd38-03bd8e33fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:31.874517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63e66-ff96-4375-bd38-03bd8e33fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:31.902908 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ecd63e66-ff96-4375-bd38-03bd8e33fbd3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:31.904264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ecd63e66-ff96-4375-bd38-03bd8e33fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:31.965722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1119/2231] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:31.976376 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:31.978555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:32.009466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:32.099349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3f0e1-0205-417f-9f64-7d735c49fa18 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:32.105038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a70ce-1070-4e20-a4b7-2a845e14fe62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:32.105982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a70ce-1070-4e20-a4b7-2a845e14fe62 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:32.106300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a70ce-1070-4e20-a4b7-2a845e14fe62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:32.106635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a70ce-1070-4e20-a4b7-2a845e14fe62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:32.121774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a70ce-1070-4e20-a4b7-2a845e14fe62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:32.123829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a70ce-1070-4e20-a4b7-2a845e14fe62 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:32.137640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1113/2232] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:59:32.436997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd63e66-ff96-4375-bd38-03bd8e33fbd3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:32.438722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ecd63e66-ff96-4375-bd38-03bd8e33fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:32.453128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd63e66-ff96-4375-bd38-03bd8e33fbd3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:32.461493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:32.462306 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:32.462595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:32.462868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] PATH_INFO: `/v3/projects/dfd5f42fc8374fae92906a128181ad69` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:32.464423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd5f42fc8374fae92906a128181ad69)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:32.468421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:32.554025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd5f42fc8374fae92906a128181ad69', 'request_id': 'req-ad570cf2-b999-4426-ab0d-75b3246f0526'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:32.565579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd5f42fc8374fae92906a128181ad69', 'request_id': 'req-ad570cf2-b999-4426-ab0d-75b3246f0526'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:32.581532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd5f42fc8374fae92906a128181ad69', 'request_id': 'req-ad570cf2-b999-4426-ab0d-75b3246f0526'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:32.597816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] The token cache is being invalidate because project dfd5f42fc8374fae92906a128181ad69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 12:59:32.598279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:32.599134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ad570cf2-b999-4426-ab0d-75b3246f0526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 12:59:32.601975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1120/2233] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 12:59:32 2022] DELETE /identity/v3/projects/dfd5f42fc8374fae92906a128181ad69 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:32.608009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1d79-a57f-40e4-ac72-e9dcf2b83bab None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:32.608381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1d79-a57f-40e4-ac72-e9dcf2b83bab None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:32.608737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1d79-a57f-40e4-ac72-e9dcf2b83bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:32.655329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bb2a1d79-a57f-40e4-ac72-e9dcf2b83bab None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:32.656545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bb2a1d79-a57f-40e4-ac72-e9dcf2b83bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:32.723003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1114/2234] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:32.731795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc5650-1eab-4f43-b93f-e2f7061cea73 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:32.732049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc5650-1eab-4f43-b93f-e2f7061cea73 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:32.732355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc5650-1eab-4f43-b93f-e2f7061cea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:32.755271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3adc5650-1eab-4f43-b93f-e2f7061cea73 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:32.756517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3adc5650-1eab-4f43-b93f-e2f7061cea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:32.766420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1121/2235] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:32.770932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a1d79-a57f-40e4-ac72-e9dcf2b83bab None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:32.781871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a1d79-a57f-40e4-ac72-e9dcf2b83bab None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:32.787340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38c7f-9423-4b61-9c71-54c5abdc9ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:32.788024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38c7f-9423-4b61-9c71-54c5abdc9ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:32.788313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38c7f-9423-4b61-9c71-54c5abdc9ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:32.788589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38c7f-9423-4b61-9c71-54c5abdc9ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:32.789406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38c7f-9423-4b61-9c71-54c5abdc9ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 12:59:32.789739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38c7f-9423-4b61-9c71-54c5abdc9ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:32.791434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38c7f-9423-4b61-9c71-54c5abdc9ed8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:32.806295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1115/2236] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 12:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 12:59:32.811685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc5650-1eab-4f43-b93f-e2f7061cea73 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:32.828387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc5650-1eab-4f43-b93f-e2f7061cea73 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:32.833731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c236fc-0090-4028-8ab8-055e8b96e3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:32.834448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c236fc-0090-4028-8ab8-055e8b96e3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:32.834726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c236fc-0090-4028-8ab8-055e8b96e3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:32.835005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c236fc-0090-4028-8ab8-055e8b96e3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:32.835745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c236fc-0090-4028-8ab8-055e8b96e3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:32.837780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c236fc-0090-4028-8ab8-055e8b96e3e2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:32.874174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1122/2237] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:59:32 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:59:32.876713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38c7f-9423-4b61-9c71-54c5abdc9ed8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:32.889889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38c7f-9423-4b61-9c71-54c5abdc9ed8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:32.956227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:32.963167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff3435-70d1-4865-9154-248ce1828b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:32.964490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff3435-70d1-4865-9154-248ce1828b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:32.964771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff3435-70d1-4865-9154-248ce1828b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:32.965046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff3435-70d1-4865-9154-248ce1828b84 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:32.965757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff3435-70d1-4865-9154-248ce1828b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:32.967769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff3435-70d1-4865-9154-248ce1828b84 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:32.990325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1116/2238] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:59:32 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:59:32.994769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c236fc-0090-4028-8ab8-055e8b96e3e2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.006956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c236fc-0090-4028-8ab8-055e8b96e3e2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.013743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54d5ff-302a-4492-b523-9a82a840d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.014502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54d5ff-302a-4492-b523-9a82a840d4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.014840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54d5ff-302a-4492-b523-9a82a840d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.015106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54d5ff-302a-4492-b523-9a82a840d4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.015813 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54d5ff-302a-4492-b523-9a82a840d4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.017825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54d5ff-302a-4492-b523-9a82a840d4d3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.031435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1123/2239] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:59:33.036513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff3435-70d1-4865-9154-248ce1828b84 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.051269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff3435-70d1-4865-9154-248ce1828b84 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.061409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17c033-ce83-4004-be75-6bbe59277c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.062362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17c033-ce83-4004-be75-6bbe59277c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.062683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17c033-ce83-4004-be75-6bbe59277c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.063026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17c033-ce83-4004-be75-6bbe59277c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.064061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17c033-ce83-4004-be75-6bbe59277c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.065765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17c033-ce83-4004-be75-6bbe59277c65 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.078137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1117/2240] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:59:33.082821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54d5ff-302a-4492-b523-9a82a840d4d3 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.094706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54d5ff-302a-4492-b523-9a82a840d4d3 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.100518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b945813-06ea-408b-976b-0e42ac81f4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.101493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b945813-06ea-408b-976b-0e42ac81f4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.101770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b945813-06ea-408b-976b-0e42ac81f4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.102047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b945813-06ea-408b-976b-0e42ac81f4b8 admin admin] PATH_INFO: `/v3/projects/8a02a78b17c64cdaabd88182ff5d15f4/users/4260e1ccff74479187f41b324de81350/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.118657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b945813-06ea-408b-976b-0e42ac81f4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a02a78b17c64cdaabd88182ff5d15f4, user_id=4260e1ccff74479187f41b324de81350, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.121391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b945813-06ea-408b-976b-0e42ac81f4b8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.137690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1124/2241] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:59:33 2022] PUT /identity/v3/projects/8a02a78b17c64cdaabd88182ff5d15f4/users/4260e1ccff74479187f41b324de81350/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:33.147978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32ac99-4c9f-4693-bfcd-de21044fe546 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.148400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32ac99-4c9f-4693-bfcd-de21044fe546 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.148682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32ac99-4c9f-4693-bfcd-de21044fe546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.177640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8a32ac99-4c9f-4693-bfcd-de21044fe546 None None] MFA Rules not processed for user `4260e1ccff74479187f41b324de81350`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:33.178899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8a32ac99-4c9f-4693-bfcd-de21044fe546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:33.272714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1118/2242] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 12:59:33.280716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b945813-06ea-408b-976b-0e42ac81f4b8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.297505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:33.360323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b945813-06ea-408b-976b-0e42ac81f4b8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.369772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9d15d-3c15-45b6-8f2b-32ef720e7a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.371621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9d15d-3c15-45b6-8f2b-32ef720e7a40 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.372475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9d15d-3c15-45b6-8f2b-32ef720e7a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.373064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9d15d-3c15-45b6-8f2b-32ef720e7a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.374867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9d15d-3c15-45b6-8f2b-32ef720e7a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.378966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9d15d-3c15-45b6-8f2b-32ef720e7a40 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.418495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1125/2243] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 12:59:33 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 12:59:33.422442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32ac99-4c9f-4693-bfcd-de21044fe546 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.434526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32ac99-4c9f-4693-bfcd-de21044fe546 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.497529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceca60-2df4-4ceb-a76f-fde6c1613f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.498263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceca60-2df4-4ceb-a76f-fde6c1613f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.498542 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceca60-2df4-4ceb-a76f-fde6c1613f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.498824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceca60-2df4-4ceb-a76f-fde6c1613f58 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.499515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceca60-2df4-4ceb-a76f-fde6c1613f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.501895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceca60-2df4-4ceb-a76f-fde6c1613f58 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.524187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1119/2244] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 12:59:33 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 12:59:33.528601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9d15d-3c15-45b6-8f2b-32ef720e7a40 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.539966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9d15d-3c15-45b6-8f2b-32ef720e7a40 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.545662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b816095-abe4-45e8-becb-7c58bd8d2e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.546429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b816095-abe4-45e8-becb-7c58bd8d2e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.546703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b816095-abe4-45e8-becb-7c58bd8d2e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.546985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b816095-abe4-45e8-becb-7c58bd8d2e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.547718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b816095-abe4-45e8-becb-7c58bd8d2e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.549419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b816095-abe4-45e8-becb-7c58bd8d2e42 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.562699 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1126/2245] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 12:59:33.567759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceca60-2df4-4ceb-a76f-fde6c1613f58 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.580888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceca60-2df4-4ceb-a76f-fde6c1613f58 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.586471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecec8d-4ed8-4100-a7de-061f3def3f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.587553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecec8d-4ed8-4100-a7de-061f3def3f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.587835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecec8d-4ed8-4100-a7de-061f3def3f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.588197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecec8d-4ed8-4100-a7de-061f3def3f7b admin admin] PATH_INFO: `/v3/projects/ae1d8c9fcc28475f842e32eda4a0351c/users/fbd44ebd4bf84ad89c4f416b09c95481/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.607061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecec8d-4ed8-4100-a7de-061f3def3f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1d8c9fcc28475f842e32eda4a0351c, user_id=fbd44ebd4bf84ad89c4f416b09c95481, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.610729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecec8d-4ed8-4100-a7de-061f3def3f7b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.628915 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1120/2246] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:59:33 2022] PUT /identity/v3/projects/ae1d8c9fcc28475f842e32eda4a0351c/users/fbd44ebd4bf84ad89c4f416b09c95481/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:33.633549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b816095-abe4-45e8-becb-7c58bd8d2e42 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.645042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b816095-abe4-45e8-becb-7c58bd8d2e42 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.710903 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8531cb6-dfb1-482a-9e17-583fe9a0e093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.711787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531cb6-dfb1-482a-9e17-583fe9a0e093 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.712070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531cb6-dfb1-482a-9e17-583fe9a0e093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.712345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8531cb6-dfb1-482a-9e17-583fe9a0e093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.713101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8531cb6-dfb1-482a-9e17-583fe9a0e093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.714802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8531cb6-dfb1-482a-9e17-583fe9a0e093 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.725789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1127/2247] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 12:59:33.730501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecec8d-4ed8-4100-a7de-061f3def3f7b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.742171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecec8d-4ed8-4100-a7de-061f3def3f7b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.747903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8c95-5ef7-42b5-9e3d-195ac5387412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.748854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8c95-5ef7-42b5-9e3d-195ac5387412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.749136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8c95-5ef7-42b5-9e3d-195ac5387412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.749400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8c95-5ef7-42b5-9e3d-195ac5387412 admin admin] PATH_INFO: `/v3/projects/ae1d8c9fcc28475f842e32eda4a0351c/users/fbd44ebd4bf84ad89c4f416b09c95481/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.751884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8c95-5ef7-42b5-9e3d-195ac5387412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1d8c9fcc28475f842e32eda4a0351c, user_id=fbd44ebd4bf84ad89c4f416b09c95481, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.754644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8c95-5ef7-42b5-9e3d-195ac5387412 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.767970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1121/2248] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 12:59:33 2022] PUT /identity/v3/projects/ae1d8c9fcc28475f842e32eda4a0351c/users/fbd44ebd4bf84ad89c4f416b09c95481/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 12:59:33.780290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57246ebd-b2f3-4de1-8758-ffd294a24b4c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.780686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57246ebd-b2f3-4de1-8758-ffd294a24b4c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.781039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57246ebd-b2f3-4de1-8758-ffd294a24b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.812024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-57246ebd-b2f3-4de1-8758-ffd294a24b4c None None] MFA Rules not processed for user `fbd44ebd4bf84ad89c4f416b09c95481`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 12:59:33.813269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-57246ebd-b2f3-4de1-8758-ffd294a24b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:33.888729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1128/2249] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 12:59:33.900809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8c95-5ef7-42b5-9e3d-195ac5387412 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:33.903006 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f9c8c95-5ef7-42b5-9e3d-195ac5387412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 12:59:33.926839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:33.969013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8c95-5ef7-42b5-9e3d-195ac5387412 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:33.973503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70c9e-6042-49d9-8849-cf9404c47ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:33.974590 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70c9e-6042-49d9-8849-cf9404c47ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:33.974974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70c9e-6042-49d9-8849-cf9404c47ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:33.975322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70c9e-6042-49d9-8849-cf9404c47ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:33.985571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a70c9e-6042-49d9-8849-cf9404c47ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:33.987242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a70c9e-6042-49d9-8849-cf9404c47ae8 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:33.998577 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1122/2250] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:59:34.086449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57246ebd-b2f3-4de1-8758-ffd294a24b4c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 12:59:34.102181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57246ebd-b2f3-4de1-8758-ffd294a24b4c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 12:59:34.106750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b8491-df84-4209-a3c7-9d0839f2d3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 12:59:34.107486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b8491-df84-4209-a3c7-9d0839f2d3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 12:59:34.107899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b8491-df84-4209-a3c7-9d0839f2d3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 12:59:34.108345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b8491-df84-4209-a3c7-9d0839f2d3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 12:59:34.115537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:34.173647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b8491-df84-4209-a3c7-9d0839f2d3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 12:59:34.175194 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b8491-df84-4209-a3c7-9d0839f2d3a6 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 12:59:34.186303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1129/2251] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 12:59:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 12:59:43.993833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=18 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 12:59:44.181448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=24 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:09.033691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01696897-f09e-48aa-ae07-c296a47fd0dd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:09.034519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01696897-f09e-48aa-ae07-c296a47fd0dd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:09.034519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01696897-f09e-48aa-ae07-c296a47fd0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:09.056329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-01696897-f09e-48aa-ae07-c296a47fd0dd None None] MFA Rules not processed for user `18195083037046bd99166f68690c3dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:09.057570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-01696897-f09e-48aa-ae07-c296a47fd0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:09.122734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1123/2252] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:13.698282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b8491-df84-4209-a3c7-9d0839f2d3a6 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:13.700775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d91b8491-df84-4209-a3c7-9d0839f2d3a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:13.815399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b8491-df84-4209-a3c7-9d0839f2d3a6 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:13.820871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:13.821652 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:13.821940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:13.822252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:13.824329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:13.836684 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:13.838718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:13.849792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1130/2253] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:19.110914 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=25 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:23.844980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=41 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:24.754602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01696897-f09e-48aa-ae07-c296a47fd0dd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:24.757066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-01696897-f09e-48aa-ae07-c296a47fd0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:24.788606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:24.790209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:24.890965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01696897-f09e-48aa-ae07-c296a47fd0dd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:24.897564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:24.898943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:24.899401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:24.899831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] PATH_INFO: `/v3/users/c7ec7651d2ab4f798e898ca6b23ed819` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:24.901587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ec7651d2ab4f798e898ca6b23ed819)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:24.905520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:25.020778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563994-eb1c-4cc0-ad49-846e50052c7d service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:25.029771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:25.030800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:25.031093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:25.031374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] PATH_INFO: `/v3/users/ba5c5ea52ca44b6691433e4f20feeb62` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:25.034230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5c5ea52ca44b6691433e4f20feeb62)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:25.036637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:25.058578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ec7651d2ab4f798e898ca6b23ed819'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.101044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ec7651d2ab4f798e898ca6b23ed819'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.102056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ec7651d2ab4f798e898ca6b23ed819'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.119133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ec7651d2ab4f798e898ca6b23ed819'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.129625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ec7651d2ab4f798e898ca6b23ed819'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.140960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5c5ea52ca44b6691433e4f20feeb62'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.141858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5c5ea52ca44b6691433e4f20feeb62'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.142645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5c5ea52ca44b6691433e4f20feeb62'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.146354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1124/2254] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:24 2022] DELETE /identity/v3/users/c7ec7651d2ab4f798e898ca6b23ed819 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:25.147334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:25.149334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:25.158049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5c5ea52ca44b6691433e4f20feeb62'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.185592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3bfb779f-a70f-4506-8552-65efc157a63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5c5ea52ca44b6691433e4f20feeb62'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.229311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1131/2255] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:24 2022] DELETE /identity/v3/users/ba5c5ea52ca44b6691433e4f20feeb62 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:00:25.230521 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcbf4d-db01-453c-a2a5-1304f9c9255d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:25.230816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcbf4d-db01-453c-a2a5-1304f9c9255d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:25.231100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcbf4d-db01-453c-a2a5-1304f9c9255d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:25.286015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd75f4-0bfc-4152-b4a4-5bdac98afb8d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:25.291219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-68dcbf4d-db01-453c-a2a5-1304f9c9255d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:25.293715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-68dcbf4d-db01-453c-a2a5-1304f9c9255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:25.320629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:25.379289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:25.380529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:25.380812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:25.381090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] PATH_INFO: `/v3/users/6c5ede9627064325b69ab0fccf2d9dc6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:25.382425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5ede9627064325b69ab0fccf2d9dc6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:25.384638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:25.410681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1132/2256] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:25.413371 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bbe02-46a7-402b-94e4-50a6d722fd34 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:25.414066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bbe02-46a7-402b-94e4-50a6d722fd34 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:25.415552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bbe02-46a7-402b-94e4-50a6d722fd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:25.440177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5d3bbe02-46a7-402b-94e4-50a6d722fd34 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:25.441401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5d3bbe02-46a7-402b-94e4-50a6d722fd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:25.451095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1133/2257] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:25.452237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bbe02-46a7-402b-94e4-50a6d722fd34 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:25.454258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5d3bbe02-46a7-402b-94e4-50a6d722fd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:25.466952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5ede9627064325b69ab0fccf2d9dc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.481314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:25.484452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5ede9627064325b69ab0fccf2d9dc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.485448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5ede9627064325b69ab0fccf2d9dc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.499111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5ede9627064325b69ab0fccf2d9dc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.518733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5ede9627064325b69ab0fccf2d9dc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:25.526277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1125/2258] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:25 2022] DELETE /identity/v3/users/6c5ede9627064325b69ab0fccf2d9dc6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:25.532038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:25.534481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:25.555719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bbe02-46a7-402b-94e4-50a6d722fd34 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:25.621593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16b0d4-5e79-4285-af9c-3ecb30393791 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:25.628894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87496b5-34c9-4039-a820-4f12de91effa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:25.630159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87496b5-34c9-4039-a820-4f12de91effa service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:25.630662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87496b5-34c9-4039-a820-4f12de91effa service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:25.631153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87496b5-34c9-4039-a820-4f12de91effa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:25.634909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d87496b5-34c9-4039-a820-4f12de91effa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:25.636996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be528c10-bd0a-4320-b008-66cf8fddcb48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:25.637681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be528c10-bd0a-4320-b008-66cf8fddcb48 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:25.637962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be528c10-bd0a-4320-b008-66cf8fddcb48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:25.638293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be528c10-bd0a-4320-b008-66cf8fddcb48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:25.640391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-be528c10-bd0a-4320-b008-66cf8fddcb48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:25.735084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:25.738219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87496b5-34c9-4039-a820-4f12de91effa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:25.739618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87496b5-34c9-4039-a820-4f12de91effa service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:25.746442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be528c10-bd0a-4320-b008-66cf8fddcb48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:25.750214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be528c10-bd0a-4320-b008-66cf8fddcb48 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:25.753102 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1126/2259] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:25.754897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b693-1464-4655-b473-a65f99fe9d16 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:25.755467 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b693-1464-4655-b473-a65f99fe9d16 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:25.755698 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b693-1464-4655-b473-a65f99fe9d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:25.777972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2e51b693-1464-4655-b473-a65f99fe9d16 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:25.779993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2e51b693-1464-4655-b473-a65f99fe9d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:25.787847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1134/2260] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:25.805956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1127/2261] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:25.844551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be528c10-bd0a-4320-b008-66cf8fddcb48 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:25.856505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be528c10-bd0a-4320-b008-66cf8fddcb48 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:25.861308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d5549-366f-4a39-b825-0fb831803faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:25.862703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d5549-366f-4a39-b825-0fb831803faa service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:25.862979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d5549-366f-4a39-b825-0fb831803faa service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:25.863118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d5549-366f-4a39-b825-0fb831803faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:25.876647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d5549-366f-4a39-b825-0fb831803faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:25.878606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d5549-366f-4a39-b825-0fb831803faa service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:25.895891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1135/2262] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:26.450446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51b693-1464-4655-b473-a65f99fe9d16 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:26.457673 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2e51b693-1464-4655-b473-a65f99fe9d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:26.476171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51b693-1464-4655-b473-a65f99fe9d16 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:26.487207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d5549-366f-4a39-b825-0fb831803faa service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:26.497551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b77d5549-366f-4a39-b825-0fb831803faa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:26.513399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:26.517177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:26.518271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d5549-366f-4a39-b825-0fb831803faa service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:26.518630 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:26.519019 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] PATH_INFO: `/v3/projects/b65bd4605d084670bf0a35c1d908e6fe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:26.521299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65bd4605d084670bf0a35c1d908e6fe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:26.525508 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:26.526707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:26.527146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:26.527980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] PATH_INFO: `/v3/projects/5a37524631214651bc19a355c0f61236` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:26.529891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a37524631214651bc19a355c0f61236)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:26.531433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:26.532803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:26.619466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a37524631214651bc19a355c0f61236', 'request_id': 'req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.632850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a37524631214651bc19a355c0f61236', 'request_id': 'req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.639950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65bd4605d084670bf0a35c1d908e6fe', 'request_id': 'req-fac6272f-03bd-44fb-82a5-715cc61107e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.648411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65bd4605d084670bf0a35c1d908e6fe', 'request_id': 'req-fac6272f-03bd-44fb-82a5-715cc61107e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.655924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a37524631214651bc19a355c0f61236', 'request_id': 'req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.656155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65bd4605d084670bf0a35c1d908e6fe', 'request_id': 'req-fac6272f-03bd-44fb-82a5-715cc61107e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.657750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:26.671481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] The token cache is being invalidate because project b65bd4605d084670bf0a35c1d908e6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:00:26.671790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.671960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] The token cache is being invalidate because project 5a37524631214651bc19a355c0f61236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:00:26.672410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.672534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.673181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-26ae8833-f9b3-49f0-b4b1-d0c9aa03ee14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.674507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1128/2263] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:00:26 2022] DELETE /identity/v3/projects/b65bd4605d084670bf0a35c1d908e6fe => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:26.674927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1136/2264] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:00:26 2022] DELETE /identity/v3/projects/5a37524631214651bc19a355c0f61236 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:26.675605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:26.676966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:26.679464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a36e7d-941d-472a-941b-e7d2089d655c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:26.679751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a36e7d-941d-472a-941b-e7d2089d655c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:26.680033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a36e7d-941d-472a-941b-e7d2089d655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:26.717409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-52a36e7d-941d-472a-941b-e7d2089d655c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:26.718840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-52a36e7d-941d-472a-941b-e7d2089d655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:26.773095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6272f-03bd-44fb-82a5-715cc61107e3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:26.787046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:26.788781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:26.789249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:26.790221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] PATH_INFO: `/v3/projects/f1550404a68e4cce9bd00dcc35468aa5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:26.792900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1550404a68e4cce9bd00dcc35468aa5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:26.797180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:26.800868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1137/2265] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:26.807681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561de133-5876-48fb-b483-8c5ebac838fb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:26.808426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561de133-5876-48fb-b483-8c5ebac838fb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:26.809208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561de133-5876-48fb-b483-8c5ebac838fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:26.830928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-561de133-5876-48fb-b483-8c5ebac838fb None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:26.832194 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-561de133-5876-48fb-b483-8c5ebac838fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:26.842347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1138/2266] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:26.843894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909dc00-a4c1-4b5c-a04b-435c63a11223 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:26.844018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909dc00-a4c1-4b5c-a04b-435c63a11223 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:26.844254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909dc00-a4c1-4b5c-a04b-435c63a11223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:26.870063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f909dc00-a4c1-4b5c-a04b-435c63a11223 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:26.872350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f909dc00-a4c1-4b5c-a04b-435c63a11223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:26.878935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1550404a68e4cce9bd00dcc35468aa5', 'request_id': 'req-836c2f32-581d-4b94-a992-1a04845cad9d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.885634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1550404a68e4cce9bd00dcc35468aa5', 'request_id': 'req-836c2f32-581d-4b94-a992-1a04845cad9d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.892947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1550404a68e4cce9bd00dcc35468aa5', 'request_id': 'req-836c2f32-581d-4b94-a992-1a04845cad9d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.910893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] The token cache is being invalidate because project f1550404a68e4cce9bd00dcc35468aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:00:26.911320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.912276 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-836c2f32-581d-4b94-a992-1a04845cad9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:26.918134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1129/2267] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:00:26 2022] DELETE /identity/v3/projects/f1550404a68e4cce9bd00dcc35468aa5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:26.918134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f044-f17d-4898-92d6-f8b84a29d5a4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:26.918134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f044-f17d-4898-92d6-f8b84a29d5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:26.918134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10f044-f17d-4898-92d6-f8b84a29d5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:26.927229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:26.944030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ee10f044-f17d-4898-92d6-f8b84a29d5a4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:26.945964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ee10f044-f17d-4898-92d6-f8b84a29d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:26.964880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1139/2268] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:26.967754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d590dac-141a-467e-a795-9ce24f0b5a93 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:26.968368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d590dac-141a-467e-a795-9ce24f0b5a93 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:26.969153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d590dac-141a-467e-a795-9ce24f0b5a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:26.998616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4d590dac-141a-467e-a795-9ce24f0b5a93 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:27.000941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4d590dac-141a-467e-a795-9ce24f0b5a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:27.016437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1140/2269] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:27.018560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d590dac-141a-467e-a795-9ce24f0b5a93 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.034330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d590dac-141a-467e-a795-9ce24f0b5a93 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.041457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fa0c0-fef6-4c2f-9ae5-538767cbacc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.042574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa0c0-fef6-4c2f-9ae5-538767cbacc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.043028 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa0c0-fef6-4c2f-9ae5-538767cbacc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.043461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa0c0-fef6-4c2f-9ae5-538767cbacc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.044720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fa0c0-fef6-4c2f-9ae5-538767cbacc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:00:27.045238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fa0c0-fef6-4c2f-9ae5-538767cbacc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.048156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fa0c0-fef6-4c2f-9ae5-538767cbacc0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.054252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1130/2270] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:27.054252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0c73-2e9c-4238-932b-553b68f14eec None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.054252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0c73-2e9c-4238-932b-553b68f14eec None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.054252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0c73-2e9c-4238-932b-553b68f14eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.076793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1141/2271] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:00:27.076793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fa0c0-fef6-4c2f-9ae5-538767cbacc0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.083805 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d33b0c73-2e9c-4238-932b-553b68f14eec None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:27.085147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d33b0c73-2e9c-4238-932b-553b68f14eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:27.092456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fa0c0-fef6-4c2f-9ae5-538767cbacc0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.096790 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1131/2272] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:27.097639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0c73-2e9c-4238-932b-553b68f14eec None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.099207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7fe34-f60f-4ac2-888d-674ec4c90e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.100350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7fe34-f60f-4ac2-888d-674ec4c90e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.100803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7fe34-f60f-4ac2-888d-674ec4c90e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.101083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7fe34-f60f-4ac2-888d-674ec4c90e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.101925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7fe34-f60f-4ac2-888d-674ec4c90e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:00:27.102259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7fe34-f60f-4ac2-888d-674ec4c90e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.105472 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7fe34-f60f-4ac2-888d-674ec4c90e3e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.113584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0c73-2e9c-4238-932b-553b68f14eec None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.122861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86809855-9077-42e3-ba46-0257437bcc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.123716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1142/2273] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:00:27.124024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86809855-9077-42e3-ba46-0257437bcc24 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.124516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86809855-9077-42e3-ba46-0257437bcc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.125004 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86809855-9077-42e3-ba46-0257437bcc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.125791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7fe34-f60f-4ac2-888d-674ec4c90e3e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.126989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86809855-9077-42e3-ba46-0257437bcc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.130817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86809855-9077-42e3-ba46-0257437bcc24 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.137248 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7fe34-f60f-4ac2-888d-674ec4c90e3e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.142977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2347-079b-480a-a986-7bbf534aa04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.143823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2347-079b-480a-a986-7bbf534aa04e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.144519 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2347-079b-480a-a986-7bbf534aa04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.144801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2347-079b-480a-a986-7bbf534aa04e admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.145540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2347-079b-480a-a986-7bbf534aa04e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:00:27.145849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2347-079b-480a-a986-7bbf534aa04e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.147617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2347-079b-480a-a986-7bbf534aa04e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.162400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1143/2274] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:00:27.163284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2347-079b-480a-a986-7bbf534aa04e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.167483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1132/2275] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:00:27 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:27.168988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86809855-9077-42e3-ba46-0257437bcc24 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.174417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2347-079b-480a-a986-7bbf534aa04e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.205382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:27.248216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f88f1-826b-40f3-8922-eff189a8a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.248952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86809855-9077-42e3-ba46-0257437bcc24 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.249097 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f88f1-826b-40f3-8922-eff189a8a795 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.249435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f88f1-826b-40f3-8922-eff189a8a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.249774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f88f1-826b-40f3-8922-eff189a8a795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.250527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f88f1-826b-40f3-8922-eff189a8a795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.252952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f88f1-826b-40f3-8922-eff189a8a795 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.256166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fefa4-f395-4d86-a428-327f969ad344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.258601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fefa4-f395-4d86-a428-327f969ad344 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.259110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fefa4-f395-4d86-a428-327f969ad344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.259668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fefa4-f395-4d86-a428-327f969ad344 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.261175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fefa4-f395-4d86-a428-327f969ad344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.264054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fefa4-f395-4d86-a428-327f969ad344 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.296666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1144/2276] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:00:27 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:27.296666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f88f1-826b-40f3-8922-eff189a8a795 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.307998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1133/2277] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:00:27 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:27.307998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fefa4-f395-4d86-a428-327f969ad344 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.328201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fefa4-f395-4d86-a428-327f969ad344 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.384544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f88f1-826b-40f3-8922-eff189a8a795 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.395554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbb507-1bfa-4146-b7fa-bac8ade358f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.396731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbb507-1bfa-4146-b7fa-bac8ade358f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.397199 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbb507-1bfa-4146-b7fa-bac8ade358f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.397731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbb507-1bfa-4146-b7fa-bac8ade358f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.398608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbb507-1bfa-4146-b7fa-bac8ade358f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.402044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbb507-1bfa-4146-b7fa-bac8ade358f9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.434025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eadeab-e652-4b70-8bb0-ca6b5f0e8df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.435273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eadeab-e652-4b70-8bb0-ca6b5f0e8df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.435733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eadeab-e652-4b70-8bb0-ca6b5f0e8df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.436177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eadeab-e652-4b70-8bb0-ca6b5f0e8df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.438259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eadeab-e652-4b70-8bb0-ca6b5f0e8df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.441905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eadeab-e652-4b70-8bb0-ca6b5f0e8df7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.445208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1145/2278] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:00:27 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:27.447249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbb507-1bfa-4146-b7fa-bac8ade358f9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.456850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:27.480393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1134/2279] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:00:27 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:27.480393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eadeab-e652-4b70-8bb0-ca6b5f0e8df7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.496797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eadeab-e652-4b70-8bb0-ca6b5f0e8df7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.555230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbb507-1bfa-4146-b7fa-bac8ade358f9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.560745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e0e1a-1ad9-4ead-a03f-89db3d64af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.561453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e0e1a-1ad9-4ead-a03f-89db3d64af88 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.561734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e0e1a-1ad9-4ead-a03f-89db3d64af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.562005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e0e1a-1ad9-4ead-a03f-89db3d64af88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.562817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e0e1a-1ad9-4ead-a03f-89db3d64af88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.564531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e0e1a-1ad9-4ead-a03f-89db3d64af88 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.587303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1146/2280] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:27.590476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e0e1a-1ad9-4ead-a03f-89db3d64af88 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.603853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28da4-fc98-467d-985d-37913fa5fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.606034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28da4-fc98-467d-985d-37913fa5fc6b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.606816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28da4-fc98-467d-985d-37913fa5fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.607126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e0e1a-1ad9-4ead-a03f-89db3d64af88 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.607965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28da4-fc98-467d-985d-37913fa5fc6b admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.609613 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e28da4-fc98-467d-985d-37913fa5fc6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.613325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be92b61-4c36-4dca-9d6e-813904b6b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.614018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be92b61-4c36-4dca-9d6e-813904b6b37d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.614344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be92b61-4c36-4dca-9d6e-813904b6b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.614624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be92b61-4c36-4dca-9d6e-813904b6b37d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.615040 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e28da4-fc98-467d-985d-37913fa5fc6b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.616119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be92b61-4c36-4dca-9d6e-813904b6b37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.617771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be92b61-4c36-4dca-9d6e-813904b6b37d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.632276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1147/2281] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:27.633076 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be92b61-4c36-4dca-9d6e-813904b6b37d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.650426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be92b61-4c36-4dca-9d6e-813904b6b37d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.657546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1135/2282] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:00:27 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:27.659598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28da4-fc98-467d-985d-37913fa5fc6b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.673763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f11aa-8833-400f-8abd-cf42b42659c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.674587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f11aa-8833-400f-8abd-cf42b42659c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.674780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f11aa-8833-400f-8abd-cf42b42659c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.675239 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f11aa-8833-400f-8abd-cf42b42659c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.675890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f11aa-8833-400f-8abd-cf42b42659c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.677800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f11aa-8833-400f-8abd-cf42b42659c4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.679631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28da4-fc98-467d-985d-37913fa5fc6b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.693525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1148/2283] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:27.694596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f11aa-8833-400f-8abd-cf42b42659c4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.698661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3e4ba-eb41-47e9-968b-da05d6eed006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.699814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3e4ba-eb41-47e9-968b-da05d6eed006 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.700111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3e4ba-eb41-47e9-968b-da05d6eed006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.700453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3e4ba-eb41-47e9-968b-da05d6eed006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.701205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3e4ba-eb41-47e9-968b-da05d6eed006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.702936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3e4ba-eb41-47e9-968b-da05d6eed006 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.710427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f11aa-8833-400f-8abd-cf42b42659c4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.721545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f96dd9-381c-4900-a49a-4b78dd07b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.722180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1136/2284] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:27.722970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3e4ba-eb41-47e9-968b-da05d6eed006 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.726725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f96dd9-381c-4900-a49a-4b78dd07b078 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.727279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f96dd9-381c-4900-a49a-4b78dd07b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.727978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f96dd9-381c-4900-a49a-4b78dd07b078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.729084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f96dd9-381c-4900-a49a-4b78dd07b078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.734417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f96dd9-381c-4900-a49a-4b78dd07b078 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.736085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3e4ba-eb41-47e9-968b-da05d6eed006 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.747380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce028b2-7fcc-4602-9969-37b97ef1a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.748385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce028b2-7fcc-4602-9969-37b97ef1a561 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.748691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce028b2-7fcc-4602-9969-37b97ef1a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.749099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce028b2-7fcc-4602-9969-37b97ef1a561 admin admin] PATH_INFO: `/v3/projects/72fbfdee26464992b66e25550a4167d2/users/2c668d46b75442e9aac3b5e26952d2aa/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.752399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1149/2285] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:27.753644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f96dd9-381c-4900-a49a-4b78dd07b078 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.763370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:27.771426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f96dd9-381c-4900-a49a-4b78dd07b078 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.776481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce028b2-7fcc-4602-9969-37b97ef1a561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72fbfdee26464992b66e25550a4167d2, user_id=2c668d46b75442e9aac3b5e26952d2aa, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.779401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce028b2-7fcc-4602-9969-37b97ef1a561 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.794361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82c3ca-5e4b-4561-ac95-efbfe65d9323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.795410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82c3ca-5e4b-4561-ac95-efbfe65d9323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.795709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82c3ca-5e4b-4561-ac95-efbfe65d9323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.796098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82c3ca-5e4b-4561-ac95-efbfe65d9323 admin admin] PATH_INFO: `/v3/projects/2e8813fef8ab4c62a4f43980c89d2977/users/9a4a87851fea4a31b164c102bb7c97eb/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.804304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1137/2286] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:00:27 2022] PUT /identity/v3/projects/72fbfdee26464992b66e25550a4167d2/users/2c668d46b75442e9aac3b5e26952d2aa/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:27.805375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce028b2-7fcc-4602-9969-37b97ef1a561 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:27.831986 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82c3ca-5e4b-4561-ac95-efbfe65d9323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8813fef8ab4c62a4f43980c89d2977, user_id=9a4a87851fea4a31b164c102bb7c97eb, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:27.844300 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82c3ca-5e4b-4561-ac95-efbfe65d9323 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:27.877174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1150/2287] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:00:27 2022] PUT /identity/v3/projects/2e8813fef8ab4c62a4f43980c89d2977/users/9a4a87851fea4a31b164c102bb7c97eb/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:27.878573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dce519-57af-4eab-bc10-c8e25649c892 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:27.878872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dce519-57af-4eab-bc10-c8e25649c892 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:27.879150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dce519-57af-4eab-bc10-c8e25649c892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:27.901538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce028b2-7fcc-4602-9969-37b97ef1a561 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:27.917991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d5dce519-57af-4eab-bc10-c8e25649c892 None None] MFA Rules not processed for user `2c668d46b75442e9aac3b5e26952d2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:27.918677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d5dce519-57af-4eab-bc10-c8e25649c892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:27.985879 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:27.996611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edf4fa-fc2c-480e-8e73-022fe4a462f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:27.997683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edf4fa-fc2c-480e-8e73-022fe4a462f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.002963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edf4fa-fc2c-480e-8e73-022fe4a462f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.003349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edf4fa-fc2c-480e-8e73-022fe4a462f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.004309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edf4fa-fc2c-480e-8e73-022fe4a462f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.006202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edf4fa-fc2c-480e-8e73-022fe4a462f1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:28.019350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1138/2288] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:28.019847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f89e7d-475b-45a9-a515-3f178a394faf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.020067 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f89e7d-475b-45a9-a515-3f178a394faf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.020311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f89e7d-475b-45a9-a515-3f178a394faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.029163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1151/2289] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:28.030069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dce519-57af-4eab-bc10-c8e25649c892 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:28.044716 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dce519-57af-4eab-bc10-c8e25649c892 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:28.051604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec338-b4ea-4ce6-b34e-9f9a3fdb66ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:28.052795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec338-b4ea-4ce6-b34e-9f9a3fdb66ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.053173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec338-b4ea-4ce6-b34e-9f9a3fdb66ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.053486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec338-b4ea-4ce6-b34e-9f9a3fdb66ab admin admin] PATH_INFO: `/v3/projects/4764e3b32dca445194f922c822eb964c/users/6dc704a926e34d56a36366e530bcc14a/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.057928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-38f89e7d-475b-45a9-a515-3f178a394faf None None] MFA Rules not processed for user `9a4a87851fea4a31b164c102bb7c97eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:28.059221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-38f89e7d-475b-45a9-a515-3f178a394faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:28.073140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dec338-b4ea-4ce6-b34e-9f9a3fdb66ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4764e3b32dca445194f922c822eb964c, user_id=6dc704a926e34d56a36366e530bcc14a, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.076879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dec338-b4ea-4ce6-b34e-9f9a3fdb66ab admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:28.094161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1152/2290] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:00:28 2022] PUT /identity/v3/projects/4764e3b32dca445194f922c822eb964c/users/6dc704a926e34d56a36366e530bcc14a/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:28.094161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec338-b4ea-4ce6-b34e-9f9a3fdb66ab admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:28.135203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1139/2291] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:28.137366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2dcf5-913b-4223-a431-b8db204d563d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.137654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2dcf5-913b-4223-a431-b8db204d563d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.137945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2dcf5-913b-4223-a431-b8db204d563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.172654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-54a2dcf5-913b-4223-a431-b8db204d563d None None] MFA Rules not processed for user `6dc704a926e34d56a36366e530bcc14a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:28.173881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-54a2dcf5-913b-4223-a431-b8db204d563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:28.192658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec338-b4ea-4ce6-b34e-9f9a3fdb66ab admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:28.200463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fbbad-83b5-45ec-92f3-4aba857bd6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:28.201278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fbbad-83b5-45ec-92f3-4aba857bd6fa admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.201580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fbbad-83b5-45ec-92f3-4aba857bd6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.201807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fbbad-83b5-45ec-92f3-4aba857bd6fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.202843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fbbad-83b5-45ec-92f3-4aba857bd6fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.205042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fbbad-83b5-45ec-92f3-4aba857bd6fa admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:28.240089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1153/2292] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:00:28 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:28.241270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fbbad-83b5-45ec-92f3-4aba857bd6fa admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:28.243039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-413fbbad-83b5-45ec-92f3-4aba857bd6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:28.250025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1140/2293] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:28.250820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2dcf5-913b-4223-a431-b8db204d563d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:28.264775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2dcf5-913b-4223-a431-b8db204d563d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:28.294736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:28.348629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccb003-6c17-461f-8485-7399a8eb9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:28.349779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccb003-6c17-461f-8485-7399a8eb9c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.350301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccb003-6c17-461f-8485-7399a8eb9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.351740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccb003-6c17-461f-8485-7399a8eb9c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.351740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccb003-6c17-461f-8485-7399a8eb9c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.353481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccb003-6c17-461f-8485-7399a8eb9c0a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:28.362027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fbbad-83b5-45ec-92f3-4aba857bd6fa admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:28.367898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7520c7-d261-41b5-a0c5-56da77d18868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:28.368587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7520c7-d261-41b5-a0c5-56da77d18868 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.369004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7520c7-d261-41b5-a0c5-56da77d18868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.369218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7520c7-d261-41b5-a0c5-56da77d18868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.378875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:28.383666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1141/2294] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:00:28 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:28.384851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccb003-6c17-461f-8485-7399a8eb9c0a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:28.388433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-40ccb003-6c17-461f-8485-7399a8eb9c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:28.407895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccb003-6c17-461f-8485-7399a8eb9c0a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:28.412082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092eeeb-cc52-4982-88f8-22f63ce8c8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:28.413412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092eeeb-cc52-4982-88f8-22f63ce8c8db service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.413718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092eeeb-cc52-4982-88f8-22f63ce8c8db service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.413968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092eeeb-cc52-4982-88f8-22f63ce8c8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.457668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7520c7-d261-41b5-a0c5-56da77d18868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.459456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7520c7-d261-41b5-a0c5-56da77d18868 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:28.482081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1154/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:28.483113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7520c7-d261-41b5-a0c5-56da77d18868 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:28.488613 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092eeeb-cc52-4982-88f8-22f63ce8c8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.490268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092eeeb-cc52-4982-88f8-22f63ce8c8db service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:28.497608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7520c7-d261-41b5-a0c5-56da77d18868 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:28.502286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1142/2296] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:28.503978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd12146-3732-4bb6-94e0-f6af3970d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:28.504780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd12146-3732-4bb6-94e0-f6af3970d9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.505161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd12146-3732-4bb6-94e0-f6af3970d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.505559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd12146-3732-4bb6-94e0-f6af3970d9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.506443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd12146-3732-4bb6-94e0-f6af3970d9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.508381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd12146-3732-4bb6-94e0-f6af3970d9d5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:28.522470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1155/2297] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:28.527584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092eeeb-cc52-4982-88f8-22f63ce8c8db service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:28.541403 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092eeeb-cc52-4982-88f8-22f63ce8c8db service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:28.550409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e8ff9-595d-436f-93b7-67d07b03ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:28.551264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e8ff9-595d-436f-93b7-67d07b03ede4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.551900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e8ff9-595d-436f-93b7-67d07b03ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.551900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e8ff9-595d-436f-93b7-67d07b03ede4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.552539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e8ff9-595d-436f-93b7-67d07b03ede4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.554211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e8ff9-595d-436f-93b7-67d07b03ede4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:28.565724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1143/2298] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:28.570142 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd12146-3732-4bb6-94e0-f6af3970d9d5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:28.586795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd12146-3732-4bb6-94e0-f6af3970d9d5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:28.594014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3da1-c9b1-47e4-bb8a-af555b54df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:28.595172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3da1-c9b1-47e4-bb8a-af555b54df2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.595659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3da1-c9b1-47e4-bb8a-af555b54df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.595946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3da1-c9b1-47e4-bb8a-af555b54df2c admin admin] PATH_INFO: `/v3/projects/a09b586511e545358260c7a8cca0599b/users/b32deeaac78e4dc789cfb6d432333d42/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.633589 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c3da1-c9b1-47e4-bb8a-af555b54df2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09b586511e545358260c7a8cca0599b, user_id=b32deeaac78e4dc789cfb6d432333d42, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.643383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c3da1-c9b1-47e4-bb8a-af555b54df2c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:28.665990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1156/2299] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:00:28 2022] PUT /identity/v3/projects/a09b586511e545358260c7a8cca0599b/users/b32deeaac78e4dc789cfb6d432333d42/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:00:28.678228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d87b-8298-4364-8160-4901c5b32d84 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.678756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d87b-8298-4364-8160-4901c5b32d84 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.679046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405d87b-8298-4364-8160-4901c5b32d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.736134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a405d87b-8298-4364-8160-4901c5b32d84 None None] MFA Rules not processed for user `b32deeaac78e4dc789cfb6d432333d42`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:28.738596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a405d87b-8298-4364-8160-4901c5b32d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:28.866165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1144/2300] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:28.872288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3da1-c9b1-47e4-bb8a-af555b54df2c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:28.960937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3da1-c9b1-47e4-bb8a-af555b54df2c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:28.972518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacc67e-5086-46ea-bfa5-a21e993f7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:28.975772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacc67e-5086-46ea-bfa5-a21e993f7d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:28.977078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacc67e-5086-46ea-bfa5-a21e993f7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:28.977400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacc67e-5086-46ea-bfa5-a21e993f7d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:28.981237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacc67e-5086-46ea-bfa5-a21e993f7d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:28.984798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacc67e-5086-46ea-bfa5-a21e993f7d0a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:29.061193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1157/2301] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:00:28 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:29.062724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405d87b-8298-4364-8160-4901c5b32d84 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:29.088996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405d87b-8298-4364-8160-4901c5b32d84 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:29.192095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39d24a-a38f-4bc5-90ac-6f1031bc72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:29.193037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39d24a-a38f-4bc5-90ac-6f1031bc72c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:29.193234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39d24a-a38f-4bc5-90ac-6f1031bc72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:29.193638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39d24a-a38f-4bc5-90ac-6f1031bc72c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:29.194529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39d24a-a38f-4bc5-90ac-6f1031bc72c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:29.197971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39d24a-a38f-4bc5-90ac-6f1031bc72c1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:29.233020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1145/2302] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:00:29 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:29.237441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacc67e-5086-46ea-bfa5-a21e993f7d0a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:29.253541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacc67e-5086-46ea-bfa5-a21e993f7d0a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:29.259609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a46bd-a7d2-40a2-b0d4-0c3b193a6a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:29.261500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a46bd-a7d2-40a2-b0d4-0c3b193a6a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:29.261956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a46bd-a7d2-40a2-b0d4-0c3b193a6a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:29.262415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a46bd-a7d2-40a2-b0d4-0c3b193a6a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:29.263409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a46bd-a7d2-40a2-b0d4-0c3b193a6a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:29.265411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a46bd-a7d2-40a2-b0d4-0c3b193a6a5e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:29.279819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1158/2303] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:29.283831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39d24a-a38f-4bc5-90ac-6f1031bc72c1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:29.295076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39d24a-a38f-4bc5-90ac-6f1031bc72c1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:29.299977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148d0da-0696-4f91-b0fa-d697ce11abf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:29.301079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148d0da-0696-4f91-b0fa-d697ce11abf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:29.301433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148d0da-0696-4f91-b0fa-d697ce11abf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:29.301768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148d0da-0696-4f91-b0fa-d697ce11abf2 admin admin] PATH_INFO: `/v3/projects/e9c53359296a4c0f93763418b442d7bb/users/5ba5d1e3a48e4d91a083f0649a9f42e2/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:29.304569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:29.326326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148d0da-0696-4f91-b0fa-d697ce11abf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c53359296a4c0f93763418b442d7bb, user_id=5ba5d1e3a48e4d91a083f0649a9f42e2, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:29.329187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148d0da-0696-4f91-b0fa-d697ce11abf2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:29.346283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1146/2304] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:00:29 2022] PUT /identity/v3/projects/e9c53359296a4c0f93763418b442d7bb/users/5ba5d1e3a48e4d91a083f0649a9f42e2/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:29.350582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a46bd-a7d2-40a2-b0d4-0c3b193a6a5e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:29.356453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:29.364392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a46bd-a7d2-40a2-b0d4-0c3b193a6a5e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:29.442515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed52e9d-dd44-41a0-bf5d-d6f02ac784cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:29.443288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed52e9d-dd44-41a0-bf5d-d6f02ac784cb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:29.443554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed52e9d-dd44-41a0-bf5d-d6f02ac784cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:29.443849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed52e9d-dd44-41a0-bf5d-d6f02ac784cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:29.444761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed52e9d-dd44-41a0-bf5d-d6f02ac784cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:29.446672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed52e9d-dd44-41a0-bf5d-d6f02ac784cb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:29.448745 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150228c-f1c7-4117-b4bb-51cd7d83dc3b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:29.449082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150228c-f1c7-4117-b4bb-51cd7d83dc3b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:29.449470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150228c-f1c7-4117-b4bb-51cd7d83dc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:29.458657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1159/2305] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:29.462976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed52e9d-dd44-41a0-bf5d-d6f02ac784cb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:29.469346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8150228c-f1c7-4117-b4bb-51cd7d83dc3b None None] MFA Rules not processed for user `b75243e37f2342c0a428d39e193e0d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:29.470603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8150228c-f1c7-4117-b4bb-51cd7d83dc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:29.473679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed52e9d-dd44-41a0-bf5d-d6f02ac784cb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:29.478707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c2b73-24d3-478c-b616-e24361149129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:29.479782 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c2b73-24d3-478c-b616-e24361149129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:29.480114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c2b73-24d3-478c-b616-e24361149129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:29.480648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c2b73-24d3-478c-b616-e24361149129 admin admin] PATH_INFO: `/v3/projects/e9c53359296a4c0f93763418b442d7bb/users/5ba5d1e3a48e4d91a083f0649a9f42e2/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:29.482566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c2b73-24d3-478c-b616-e24361149129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c53359296a4c0f93763418b442d7bb, user_id=5ba5d1e3a48e4d91a083f0649a9f42e2, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:29.485272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c2b73-24d3-478c-b616-e24361149129 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:29.498156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1160/2306] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:00:29 2022] PUT /identity/v3/projects/e9c53359296a4c0f93763418b442d7bb/users/5ba5d1e3a48e4d91a083f0649a9f42e2/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:00:29.509114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec785b00-2441-45b6-a4f5-9ed316f41234 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:29.509395 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec785b00-2441-45b6-a4f5-9ed316f41234 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:29.509671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec785b00-2441-45b6-a4f5-9ed316f41234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:29.532642 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1147/2307] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:00:29.540196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ec785b00-2441-45b6-a4f5-9ed316f41234 None None] MFA Rules not processed for user `5ba5d1e3a48e4d91a083f0649a9f42e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:29.541750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ec785b00-2441-45b6-a4f5-9ed316f41234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:29.633393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1161/2308] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:00:29.646596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150228c-f1c7-4117-b4bb-51cd7d83dc3b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:29.723293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150228c-f1c7-4117-b4bb-51cd7d83dc3b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:29.810668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28943-effc-403f-ba6b-1ce01e357766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:29.811536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28943-effc-403f-ba6b-1ce01e357766 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:29.811818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28943-effc-403f-ba6b-1ce01e357766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:29.812090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28943-effc-403f-ba6b-1ce01e357766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:29.901938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b28943-effc-403f-ba6b-1ce01e357766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:29.903600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b28943-effc-403f-ba6b-1ce01e357766 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:29.908281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:29.917785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1148/2309] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:00:31.791453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec785b00-2441-45b6-a4f5-9ed316f41234 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:31.803797 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec785b00-2441-45b6-a4f5-9ed316f41234 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:31.809399 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56051c53-2649-4b22-b86f-22ce2e97f09d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:31.809760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56051c53-2649-4b22-b86f-22ce2e97f09d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:31.809984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56051c53-2649-4b22-b86f-22ce2e97f09d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:31.810280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56051c53-2649-4b22-b86f-22ce2e97f09d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:31.884207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56051c53-2649-4b22-b86f-22ce2e97f09d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:31.885961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56051c53-2649-4b22-b86f-22ce2e97f09d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:31.896624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1162/2310] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:36.251905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28943-effc-403f-ba6b-1ce01e357766 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:36.262423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28943-effc-403f-ba6b-1ce01e357766 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:36.267201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5da87f-deff-4b89-b81d-e6ab49f4d025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:36.268053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da87f-deff-4b89-b81d-e6ab49f4d025 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:36.268384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da87f-deff-4b89-b81d-e6ab49f4d025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:36.268757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da87f-deff-4b89-b81d-e6ab49f4d025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:36.282425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5da87f-deff-4b89-b81d-e6ab49f4d025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:36.285138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5da87f-deff-4b89-b81d-e6ab49f4d025 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:36.302156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1149/2311] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:41.892298 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:43.105216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56051c53-2649-4b22-b86f-22ce2e97f09d service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:43.207667 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56051c53-2649-4b22-b86f-22ce2e97f09d service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:43.216454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:43.217515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:43.217982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:43.218321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] PATH_INFO: `/v3/users/9a4a87851fea4a31b164c102bb7c97eb` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:43.222597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4a87851fea4a31b164c102bb7c97eb)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:43.225091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:43.344957 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4a87851fea4a31b164c102bb7c97eb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:43.345722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4a87851fea4a31b164c102bb7c97eb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:43.346385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4a87851fea4a31b164c102bb7c97eb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:43.359225 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4a87851fea4a31b164c102bb7c97eb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:43.369927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4a87851fea4a31b164c102bb7c97eb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:43.397622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1163/2312] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:43 2022] DELETE /identity/v3/users/9a4a87851fea4a31b164c102bb7c97eb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:43.402934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7722f2-3932-4269-a20f-b6cc7d33b845 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:43.403555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7722f2-3932-4269-a20f-b6cc7d33b845 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:43.403555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7722f2-3932-4269-a20f-b6cc7d33b845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:43.430334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7e7722f2-3932-4269-a20f-b6cc7d33b845 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:43.432128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e7722f2-3932-4269-a20f-b6cc7d33b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:43.553651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1150/2313] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:43.565791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:43.567943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:43.682889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003648e7-9e07-45e9-b721-b8f9f6b4f559 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:43.690458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40de2f-d0ea-462f-a33d-33a536b96341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:43.691271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40de2f-d0ea-462f-a33d-33a536b96341 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:43.691732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40de2f-d0ea-462f-a33d-33a536b96341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:43.692032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40de2f-d0ea-462f-a33d-33a536b96341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:43.711549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40de2f-d0ea-462f-a33d-33a536b96341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:43.712131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40de2f-d0ea-462f-a33d-33a536b96341 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:43.740556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1164/2314] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:44.173056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7722f2-3932-4269-a20f-b6cc7d33b845 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:44.175743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e7722f2-3932-4269-a20f-b6cc7d33b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:44.198549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7722f2-3932-4269-a20f-b6cc7d33b845 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:44.215083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:44.219243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:44.219880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:44.221123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] PATH_INFO: `/v3/projects/2e8813fef8ab4c62a4f43980c89d2977` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:44.226380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8813fef8ab4c62a4f43980c89d2977)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:44.230548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:44.338250 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8813fef8ab4c62a4f43980c89d2977', 'request_id': 'req-997c947e-6057-4066-a4bb-e161d989ed17'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:44.354888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8813fef8ab4c62a4f43980c89d2977', 'request_id': 'req-997c947e-6057-4066-a4bb-e161d989ed17'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:44.378131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8813fef8ab4c62a4f43980c89d2977', 'request_id': 'req-997c947e-6057-4066-a4bb-e161d989ed17'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:44.418840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] The token cache is being invalidate because project 2e8813fef8ab4c62a4f43980c89d2977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:00:44.419559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:44.429518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-997c947e-6057-4066-a4bb-e161d989ed17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:44.432520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1151/2315] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:00:44 2022] DELETE /identity/v3/projects/2e8813fef8ab4c62a4f43980c89d2977 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:44.440096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c429-a7b4-4ba4-88ce-dc3cd508fc93 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:44.441072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c429-a7b4-4ba4-88ce-dc3cd508fc93 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:44.441503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c429-a7b4-4ba4-88ce-dc3cd508fc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:44.489163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1345c429-a7b4-4ba4-88ce-dc3cd508fc93 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:44.494040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1345c429-a7b4-4ba4-88ce-dc3cd508fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:44.563380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:44.653942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1165/2316] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:44.668087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290d270-ffcb-4893-a3b7-6c0c1328ccd2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:44.668527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290d270-ffcb-4893-a3b7-6c0c1328ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:44.669045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290d270-ffcb-4893-a3b7-6c0c1328ccd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:44.702782 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1290d270-ffcb-4893-a3b7-6c0c1328ccd2 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:44.704173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1290d270-ffcb-4893-a3b7-6c0c1328ccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:44.715809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1152/2317] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:00:44.719089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c429-a7b4-4ba4-88ce-dc3cd508fc93 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:44.734313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c429-a7b4-4ba4-88ce-dc3cd508fc93 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:44.740285 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd59e0e-f867-42f2-932c-56b43739ea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:44.741012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd59e0e-f867-42f2-932c-56b43739ea3a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:44.741302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd59e0e-f867-42f2-932c-56b43739ea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:44.741586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd59e0e-f867-42f2-932c-56b43739ea3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:44.742579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd59e0e-f867-42f2-932c-56b43739ea3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:00:44.742890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd59e0e-f867-42f2-932c-56b43739ea3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:44.744604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd59e0e-f867-42f2-932c-56b43739ea3a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:44.759635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1166/2318] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:00:44.764632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290d270-ffcb-4893-a3b7-6c0c1328ccd2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:44.774699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290d270-ffcb-4893-a3b7-6c0c1328ccd2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:44.780160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0fc13-c938-4e2e-b590-1ad0faa76558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:44.780870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0fc13-c938-4e2e-b590-1ad0faa76558 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:44.781155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0fc13-c938-4e2e-b590-1ad0faa76558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:44.781446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0fc13-c938-4e2e-b590-1ad0faa76558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:44.782187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0fc13-c938-4e2e-b590-1ad0faa76558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:44.784186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0fc13-c938-4e2e-b590-1ad0faa76558 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:44.852259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1153/2319] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:00:44 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:44.853917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd59e0e-f867-42f2-932c-56b43739ea3a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:44.866679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd59e0e-f867-42f2-932c-56b43739ea3a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:44.975824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24345b-7d08-4b2c-8748-680c7a009ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:44.976789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24345b-7d08-4b2c-8748-680c7a009ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:44.977146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24345b-7d08-4b2c-8748-680c7a009ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:44.977490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24345b-7d08-4b2c-8748-680c7a009ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:44.978333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24345b-7d08-4b2c-8748-680c7a009ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:44.980593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24345b-7d08-4b2c-8748-680c7a009ef2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:45.010697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1167/2320] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:00:44 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:45.018426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0fc13-c938-4e2e-b590-1ad0faa76558 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:45.033624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0fc13-c938-4e2e-b590-1ad0faa76558 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:45.038918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cec9db-0578-4572-b0fa-c5e59ff231a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:45.039813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cec9db-0578-4572-b0fa-c5e59ff231a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:45.040308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cec9db-0578-4572-b0fa-c5e59ff231a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:45.040954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cec9db-0578-4572-b0fa-c5e59ff231a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:45.041978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cec9db-0578-4572-b0fa-c5e59ff231a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:45.044259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cec9db-0578-4572-b0fa-c5e59ff231a2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:45.063608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1154/2321] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:45.064882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24345b-7d08-4b2c-8748-680c7a009ef2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:45.077728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24345b-7d08-4b2c-8748-680c7a009ef2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:45.089750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5837c-68c9-4e6d-86b2-1104ff2fb37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:45.090913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5837c-68c9-4e6d-86b2-1104ff2fb37d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:45.091320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5837c-68c9-4e6d-86b2-1104ff2fb37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:45.091735 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5837c-68c9-4e6d-86b2-1104ff2fb37d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:45.092623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5837c-68c9-4e6d-86b2-1104ff2fb37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:45.094456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5837c-68c9-4e6d-86b2-1104ff2fb37d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:45.110192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1168/2322] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 13:00:45.111977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cec9db-0578-4572-b0fa-c5e59ff231a2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:45.130413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cec9db-0578-4572-b0fa-c5e59ff231a2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:45.138389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb3717-321f-4d62-94bc-20fc0fc7b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:45.140218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb3717-321f-4d62-94bc-20fc0fc7b01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:45.141507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb3717-321f-4d62-94bc-20fc0fc7b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:45.142629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb3717-321f-4d62-94bc-20fc0fc7b01b admin admin] PATH_INFO: `/v3/projects/e45573c0bf63441bbee3cb26703525c2/users/36eb8228334a41169ccead2c5267d125/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:45.182532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb3717-321f-4d62-94bc-20fc0fc7b01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45573c0bf63441bbee3cb26703525c2, user_id=36eb8228334a41169ccead2c5267d125, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:45.185587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb3717-321f-4d62-94bc-20fc0fc7b01b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:45.204900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1155/2323] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:00:45 2022] PUT /identity/v3/projects/e45573c0bf63441bbee3cb26703525c2/users/36eb8228334a41169ccead2c5267d125/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:00:45.216940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db5eb-9d09-4f8f-a439-27da0d50a2d5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:45.217421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db5eb-9d09-4f8f-a439-27da0d50a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:45.217619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db5eb-9d09-4f8f-a439-27da0d50a2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:45.265304 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d20db5eb-9d09-4f8f-a439-27da0d50a2d5 None None] MFA Rules not processed for user `36eb8228334a41169ccead2c5267d125`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:45.266974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d20db5eb-9d09-4f8f-a439-27da0d50a2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:45.392294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1169/2324] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:45.427490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb3717-321f-4d62-94bc-20fc0fc7b01b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:45.430326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-20cb3717-321f-4d62-94bc-20fc0fc7b01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:45.438962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:45.509621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb3717-321f-4d62-94bc-20fc0fc7b01b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:45.514236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b8272-c3bc-4f10-9904-ec01425c2ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:45.514750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b8272-c3bc-4f10-9904-ec01425c2ede service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:45.515027 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b8272-c3bc-4f10-9904-ec01425c2ede service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:45.515401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b8272-c3bc-4f10-9904-ec01425c2ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:45.526460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b8272-c3bc-4f10-9904-ec01425c2ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:45.528626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b8272-c3bc-4f10-9904-ec01425c2ede service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:45.539350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1156/2325] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:45.575405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20db5eb-9d09-4f8f-a439-27da0d50a2d5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:45.604268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:45.670407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20db5eb-9d09-4f8f-a439-27da0d50a2d5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:45.675451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:45.676441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:45.676776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:45.677817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] PATH_INFO: `/v3/users/36eb8228334a41169ccead2c5267d125` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:45.679581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36eb8228334a41169ccead2c5267d125)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:45.684575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:45.784131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36eb8228334a41169ccead2c5267d125'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:45.784965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36eb8228334a41169ccead2c5267d125'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:45.785954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36eb8228334a41169ccead2c5267d125'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:45.797694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36eb8228334a41169ccead2c5267d125'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:45.819172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36eb8228334a41169ccead2c5267d125'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:45.855860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1170/2326] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:45 2022] DELETE /identity/v3/users/36eb8228334a41169ccead2c5267d125 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:00:45.861779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff443-4ab8-481f-9f3d-2b71d84b6740 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:45.862939 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff443-4ab8-481f-9f3d-2b71d84b6740 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:45.863823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff443-4ab8-481f-9f3d-2b71d84b6740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:45.913394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b6cff443-4ab8-481f-9f3d-2b71d84b6740 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:45.915627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b6cff443-4ab8-481f-9f3d-2b71d84b6740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:46.039482 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1157/2327] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:46.052310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:46.053875 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:46.191705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6e088-0d7f-4edd-a8ef-0cca301c38c9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:46.204063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18fe1c-4120-46f8-9059-877a97ad6714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:46.204793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18fe1c-4120-46f8-9059-877a97ad6714 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:46.205090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18fe1c-4120-46f8-9059-877a97ad6714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:46.205425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18fe1c-4120-46f8-9059-877a97ad6714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:46.240974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18fe1c-4120-46f8-9059-877a97ad6714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:46.242831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18fe1c-4120-46f8-9059-877a97ad6714 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:46.259360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1171/2328] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:46.677658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff443-4ab8-481f-9f3d-2b71d84b6740 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:46.680835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b6cff443-4ab8-481f-9f3d-2b71d84b6740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:46.706451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff443-4ab8-481f-9f3d-2b71d84b6740 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:46.715081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:46.716589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:46.717314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:46.718157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] PATH_INFO: `/v3/projects/e45573c0bf63441bbee3cb26703525c2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:46.720626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45573c0bf63441bbee3cb26703525c2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:46.725600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:46.865909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45573c0bf63441bbee3cb26703525c2', 'request_id': 'req-b30248ec-eac0-4acd-9258-7851223386f8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:46.880346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45573c0bf63441bbee3cb26703525c2', 'request_id': 'req-b30248ec-eac0-4acd-9258-7851223386f8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:46.892702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45573c0bf63441bbee3cb26703525c2', 'request_id': 'req-b30248ec-eac0-4acd-9258-7851223386f8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:46.920839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] The token cache is being invalidate because project e45573c0bf63441bbee3cb26703525c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:00:46.921683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:46.927870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b30248ec-eac0-4acd-9258-7851223386f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:46.931373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1158/2329] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:00:46 2022] DELETE /identity/v3/projects/e45573c0bf63441bbee3cb26703525c2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:47.342387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18fe1c-4120-46f8-9059-877a97ad6714 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:47.344163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ad18fe1c-4120-46f8-9059-877a97ad6714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:47.358557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18fe1c-4120-46f8-9059-877a97ad6714 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:47.411974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:47.439604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:47.440978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:47.441336 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:47.441692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] PATH_INFO: `/v3/users/2c668d46b75442e9aac3b5e26952d2aa` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:47.443198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c668d46b75442e9aac3b5e26952d2aa)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:47.445638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:47.511264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c668d46b75442e9aac3b5e26952d2aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:47.514994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c668d46b75442e9aac3b5e26952d2aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:47.515985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c668d46b75442e9aac3b5e26952d2aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:47.526365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c668d46b75442e9aac3b5e26952d2aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:47.538953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c668d46b75442e9aac3b5e26952d2aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:47.561106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1172/2330] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:47 2022] DELETE /identity/v3/users/2c668d46b75442e9aac3b5e26952d2aa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:47.565963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0839-4a20-458b-aaf7-7bb7db4b3bc7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:47.566308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0839-4a20-458b-aaf7-7bb7db4b3bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:47.566546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0839-4a20-458b-aaf7-7bb7db4b3bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:47.601647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-df0e0839-4a20-458b-aaf7-7bb7db4b3bc7 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:47.604428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-df0e0839-4a20-458b-aaf7-7bb7db4b3bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:47.650933 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:47.698244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1159/2331] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:47.708784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:47.710405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:47.830374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268c237-0dee-4a16-a953-f0097b3bd160 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:47.840036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7a12a-c69a-4827-b013-71e8abdc77d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:47.841102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7a12a-c69a-4827-b013-71e8abdc77d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:47.841555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7a12a-c69a-4827-b013-71e8abdc77d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:47.842005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7a12a-c69a-4827-b013-71e8abdc77d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:47.869162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7a12a-c69a-4827-b013-71e8abdc77d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:47.872428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7a12a-c69a-4827-b013-71e8abdc77d6 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:47.897595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1173/2332] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:48.132059 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0839-4a20-458b-aaf7-7bb7db4b3bc7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:48.143923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0839-4a20-458b-aaf7-7bb7db4b3bc7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:48.148983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ec0c0-1171-42b3-95f6-d4cec4a07a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:48.149760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ec0c0-1171-42b3-95f6-d4cec4a07a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:48.150303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ec0c0-1171-42b3-95f6-d4cec4a07a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:48.150732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ec0c0-1171-42b3-95f6-d4cec4a07a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:48.155029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-458ec0c0-1171-42b3-95f6-d4cec4a07a91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:48.254589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ec0c0-1171-42b3-95f6-d4cec4a07a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:48.257906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ec0c0-1171-42b3-95f6-d4cec4a07a91 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:48.277986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1160/2333] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:00:48.291587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7a12a-c69a-4827-b013-71e8abdc77d6 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:48.293478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fea7a12a-c69a-4827-b013-71e8abdc77d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:48.314078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7a12a-c69a-4827-b013-71e8abdc77d6 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:48.343560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:48.345121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:48.345824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:48.346417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] PATH_INFO: `/v3/projects/72fbfdee26464992b66e25550a4167d2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:48.350593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72fbfdee26464992b66e25550a4167d2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:48.355846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:48.463474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72fbfdee26464992b66e25550a4167d2', 'request_id': 'req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.476365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72fbfdee26464992b66e25550a4167d2', 'request_id': 'req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.481520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:48.489171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72fbfdee26464992b66e25550a4167d2', 'request_id': 'req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.511237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] The token cache is being invalidate because project 72fbfdee26464992b66e25550a4167d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:00:48.511795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.512839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.515126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1174/2334] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:00:48 2022] DELETE /identity/v3/projects/72fbfdee26464992b66e25550a4167d2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:00:48.521469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ec0c0-1171-42b3-95f6-d4cec4a07a91 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:48.542568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ec0c0-1171-42b3-95f6-d4cec4a07a91 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:48.679458 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:48.681015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:48.681510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:48.681996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] PATH_INFO: `/v3/users/b32deeaac78e4dc789cfb6d432333d42` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:48.685258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32deeaac78e4dc789cfb6d432333d42)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:48.689278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:48.780179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32deeaac78e4dc789cfb6d432333d42'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.793414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32deeaac78e4dc789cfb6d432333d42'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.794277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32deeaac78e4dc789cfb6d432333d42'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.797342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:48.805409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32deeaac78e4dc789cfb6d432333d42'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.821058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32deeaac78e4dc789cfb6d432333d42'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:48.834166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1161/2335] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:48 2022] DELETE /identity/v3/users/b32deeaac78e4dc789cfb6d432333d42 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:49.270943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:49.272627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:49.292175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cf0bf-309d-4f2f-a385-f43f0aa91513 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:49.369934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:49.371023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:49.371414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:49.371906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] PATH_INFO: `/v3/projects/a09b586511e545358260c7a8cca0599b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:49.373448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09b586511e545358260c7a8cca0599b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:49.375313 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:49.458620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09b586511e545358260c7a8cca0599b', 'request_id': 'req-c0c74069-600f-4dee-8fa6-7bcd9d47f613'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.467852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09b586511e545358260c7a8cca0599b', 'request_id': 'req-c0c74069-600f-4dee-8fa6-7bcd9d47f613'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.477242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09b586511e545358260c7a8cca0599b', 'request_id': 'req-c0c74069-600f-4dee-8fa6-7bcd9d47f613'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.498940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] The token cache is being invalidate because project a09b586511e545358260c7a8cca0599b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:00:49.499452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.500526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.502896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1175/2336] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:00:49 2022] DELETE /identity/v3/projects/a09b586511e545358260c7a8cca0599b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:49.507168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:49.508912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:49.524114 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53610d-0f12-4d0f-a09a-5e03f84f7151 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:49.611322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:49.612281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:49.612568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:49.612846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] PATH_INFO: `/v3/users/5ba5d1e3a48e4d91a083f0649a9f42e2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:49.614477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba5d1e3a48e4d91a083f0649a9f42e2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:49.616431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:49.688031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba5d1e3a48e4d91a083f0649a9f42e2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.710745 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba5d1e3a48e4d91a083f0649a9f42e2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.712202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba5d1e3a48e4d91a083f0649a9f42e2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.723896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba5d1e3a48e4d91a083f0649a9f42e2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.733656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba5d1e3a48e4d91a083f0649a9f42e2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:49.740872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1162/2337] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:49 2022] DELETE /identity/v3/users/5ba5d1e3a48e4d91a083f0649a9f42e2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:50.278890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:50.280406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:50.309632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c74069-600f-4dee-8fa6-7bcd9d47f613 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:50.435556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:50.436794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:50.437146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:50.437463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] PATH_INFO: `/v3/projects/e9c53359296a4c0f93763418b442d7bb` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:50.448265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c53359296a4c0f93763418b442d7bb)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:50.454354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:50.483147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:50.526353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c53359296a4c0f93763418b442d7bb', 'request_id': 'req-4b01992b-a6fc-490f-a695-a5b38a64a1fa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:50.535806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c53359296a4c0f93763418b442d7bb', 'request_id': 'req-4b01992b-a6fc-490f-a695-a5b38a64a1fa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:50.546547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c53359296a4c0f93763418b442d7bb', 'request_id': 'req-4b01992b-a6fc-490f-a695-a5b38a64a1fa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:50.563184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] The token cache is being invalidate because project e9c53359296a4c0f93763418b442d7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:00:50.563685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:50.564915 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4b01992b-a6fc-490f-a695-a5b38a64a1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:50.566970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1176/2338] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:00:50 2022] DELETE /identity/v3/projects/e9c53359296a4c0f93763418b442d7bb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:55.717727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:55.721015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:55.737570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ed9a7-a6f0-46bd-8187-eacf90449d0b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:55.817742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:55.818778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:55.819076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:55.819395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] PATH_INFO: `/v3/users/6dc704a926e34d56a36366e530bcc14a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:55.820742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc704a926e34d56a36366e530bcc14a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:55.822965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:55.828890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:55.887691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc704a926e34d56a36366e530bcc14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:55.900414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc704a926e34d56a36366e530bcc14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:55.901154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc704a926e34d56a36366e530bcc14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:55.910170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc704a926e34d56a36366e530bcc14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:55.920106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc704a926e34d56a36366e530bcc14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:55.926846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1163/2339] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:55 2022] DELETE /identity/v3/users/6dc704a926e34d56a36366e530bcc14a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:55.932717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0059eb-48e2-4684-8563-d7ef5d508fbe None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:55.934382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0059eb-48e2-4684-8563-d7ef5d508fbe None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:55.934382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0059eb-48e2-4684-8563-d7ef5d508fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:55.955685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4b0059eb-48e2-4684-8563-d7ef5d508fbe None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:55.956982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4b0059eb-48e2-4684-8563-d7ef5d508fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:56.024232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1177/2340] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:56.037329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:56.039676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:56.120079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224b47e-1125-428e-89ab-4d0c1d2ad447 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:56.130843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c766174-97af-471f-a97d-01390d1772da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:56.131534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c766174-97af-471f-a97d-01390d1772da service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:56.131815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c766174-97af-471f-a97d-01390d1772da service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:56.132094 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c766174-97af-471f-a97d-01390d1772da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:56.142861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c766174-97af-471f-a97d-01390d1772da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:56.144350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c766174-97af-471f-a97d-01390d1772da service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:56.156280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1164/2341] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:00:56.487388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0059eb-48e2-4684-8563-d7ef5d508fbe None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:56.488870 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4b0059eb-48e2-4684-8563-d7ef5d508fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:56.503614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0059eb-48e2-4684-8563-d7ef5d508fbe None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:56.511176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:56.513630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:56.514220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:56.514746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] PATH_INFO: `/v3/projects/4764e3b32dca445194f922c822eb964c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:56.517189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4764e3b32dca445194f922c822eb964c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:56.521438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:56.600007 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4764e3b32dca445194f922c822eb964c', 'request_id': 'req-f154328a-8d9f-4e57-8f9a-2115770e3bb3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:56.607525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4764e3b32dca445194f922c822eb964c', 'request_id': 'req-f154328a-8d9f-4e57-8f9a-2115770e3bb3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:56.618673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4764e3b32dca445194f922c822eb964c', 'request_id': 'req-f154328a-8d9f-4e57-8f9a-2115770e3bb3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:56.630994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] The token cache is being invalidate because project 4764e3b32dca445194f922c822eb964c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:00:56.631282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:56.631963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f154328a-8d9f-4e57-8f9a-2115770e3bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:56.633558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1178/2342] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:00:56 2022] DELETE /identity/v3/projects/4764e3b32dca445194f922c822eb964c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:56.641711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6b0b-f97c-44fd-a9dc-4bf23a91fb5e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:56.641711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6b0b-f97c-44fd-a9dc-4bf23a91fb5e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:56.642164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6b0b-f97c-44fd-a9dc-4bf23a91fb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:56.663821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c25b6b0b-f97c-44fd-a9dc-4bf23a91fb5e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:56.665074 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c25b6b0b-f97c-44fd-a9dc-4bf23a91fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:56.743558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1165/2343] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:56.754301 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed659519-75ec-4127-8b87-532b3fe818e8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:56.754604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed659519-75ec-4127-8b87-532b3fe818e8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:56.755120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed659519-75ec-4127-8b87-532b3fe818e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:56.782059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ed659519-75ec-4127-8b87-532b3fe818e8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:56.783627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ed659519-75ec-4127-8b87-532b3fe818e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:56.797791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1179/2344] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:56.799030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6b0b-f97c-44fd-a9dc-4bf23a91fb5e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:56.810297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6b0b-f97c-44fd-a9dc-4bf23a91fb5e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:56.818956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d41e-dacc-48d6-91d7-2e4a16c1b8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:56.819856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d41e-dacc-48d6-91d7-2e4a16c1b8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:56.820216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d41e-dacc-48d6-91d7-2e4a16c1b8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:56.820373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484d41e-dacc-48d6-91d7-2e4a16c1b8f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:56.821087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484d41e-dacc-48d6-91d7-2e4a16c1b8f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:00:56.821398 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484d41e-dacc-48d6-91d7-2e4a16c1b8f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:56.823188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484d41e-dacc-48d6-91d7-2e4a16c1b8f0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:56.840538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1166/2345] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:00:56.851662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed659519-75ec-4127-8b87-532b3fe818e8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:56.864758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed659519-75ec-4127-8b87-532b3fe818e8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:56.871201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1c6e6-72af-430e-b0e1-2571472e50a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:56.871201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1c6e6-72af-430e-b0e1-2571472e50a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:56.871201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1c6e6-72af-430e-b0e1-2571472e50a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:56.871548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1c6e6-72af-430e-b0e1-2571472e50a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:56.872116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1c6e6-72af-430e-b0e1-2571472e50a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:56.874204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1c6e6-72af-430e-b0e1-2571472e50a8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:56.905564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:56.912616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1180/2346] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:00:56 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:00:56.919514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d41e-dacc-48d6-91d7-2e4a16c1b8f0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:56.937461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484d41e-dacc-48d6-91d7-2e4a16c1b8f0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:56.957980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:57.054778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cd99e-eca0-47f4-a1c0-76e87f7396f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:57.055478 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cd99e-eca0-47f4-a1c0-76e87f7396f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:57.055769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cd99e-eca0-47f4-a1c0-76e87f7396f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:57.056060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cd99e-eca0-47f4-a1c0-76e87f7396f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:57.056795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cd99e-eca0-47f4-a1c0-76e87f7396f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:57.059089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cd99e-eca0-47f4-a1c0-76e87f7396f5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:57.088572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1167/2347] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:00:56 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:00:57.092768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1c6e6-72af-430e-b0e1-2571472e50a8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:57.105075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1c6e6-72af-430e-b0e1-2571472e50a8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:57.123301 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a1576-ee6e-4c17-8803-24caf7098807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:57.124966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a1576-ee6e-4c17-8803-24caf7098807 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:57.125499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a1576-ee6e-4c17-8803-24caf7098807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:57.126223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a1576-ee6e-4c17-8803-24caf7098807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:57.128267 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a1576-ee6e-4c17-8803-24caf7098807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:57.134439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a1576-ee6e-4c17-8803-24caf7098807 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:57.162703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1181/2348] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 13:00:57.167847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cd99e-eca0-47f4-a1c0-76e87f7396f5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:57.183407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cd99e-eca0-47f4-a1c0-76e87f7396f5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:57.199461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf0d7c-6530-4d42-9b80-4bf387a57018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:57.200233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf0d7c-6530-4d42-9b80-4bf387a57018 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:57.200772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf0d7c-6530-4d42-9b80-4bf387a57018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:57.200772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf0d7c-6530-4d42-9b80-4bf387a57018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:57.201532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf0d7c-6530-4d42-9b80-4bf387a57018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:57.203594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf0d7c-6530-4d42-9b80-4bf387a57018 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:57.239775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1168/2349] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:00:57.241548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a1576-ee6e-4c17-8803-24caf7098807 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:57.253700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a1576-ee6e-4c17-8803-24caf7098807 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:57.259923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ea91-7c26-466a-a88c-2a41de244474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:57.260902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ea91-7c26-466a-a88c-2a41de244474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:57.261183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ea91-7c26-466a-a88c-2a41de244474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:57.261530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ea91-7c26-466a-a88c-2a41de244474 admin admin] PATH_INFO: `/v3/projects/1686ea199c5442958f97102a61ce41aa/users/e7a99ccc238943a098833d03c6233413/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:57.281657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1ea91-7c26-466a-a88c-2a41de244474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1686ea199c5442958f97102a61ce41aa, user_id=e7a99ccc238943a098833d03c6233413, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:57.284510 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1ea91-7c26-466a-a88c-2a41de244474 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:57.306853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1182/2350] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:00:57 2022] PUT /identity/v3/projects/1686ea199c5442958f97102a61ce41aa/users/e7a99ccc238943a098833d03c6233413/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:57.312687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d932-38af-4920-945b-8d674ad19a74 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:57.312980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d932-38af-4920-945b-8d674ad19a74 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:57.313262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d932-38af-4920-945b-8d674ad19a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:57.336557 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9352d932-38af-4920-945b-8d674ad19a74 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:57.337911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9352d932-38af-4920-945b-8d674ad19a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:57.413499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1169/2351] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:00:57.427447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ea91-7c26-466a-a88c-2a41de244474 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:57.429532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-89b1ea91-7c26-466a-a88c-2a41de244474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:57.500457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ea91-7c26-466a-a88c-2a41de244474 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:57.504675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0711cf-9246-4358-b511-d14348722ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:57.505360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0711cf-9246-4358-b511-d14348722ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:57.505659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0711cf-9246-4358-b511-d14348722ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:57.505921 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0711cf-9246-4358-b511-d14348722ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:57.518196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0711cf-9246-4358-b511-d14348722ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:57.520135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0711cf-9246-4358-b511-d14348722ec9 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:57.533701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1183/2352] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:00:58.907236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352d932-38af-4920-945b-8d674ad19a74 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:58.908667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9352d932-38af-4920-945b-8d674ad19a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:58.921792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352d932-38af-4920-945b-8d674ad19a74 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:58.927489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:58.928470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:58.928737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:58.929015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] PATH_INFO: `/v3/users/4260e1ccff74479187f41b324de81350` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:58.930412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4260e1ccff74479187f41b324de81350)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:58.932428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:58.993431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4260e1ccff74479187f41b324de81350'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:59.017070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4260e1ccff74479187f41b324de81350'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:59.018360 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4260e1ccff74479187f41b324de81350'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:59.052166 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4260e1ccff74479187f41b324de81350'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:59.072134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4260e1ccff74479187f41b324de81350'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:00:59.095726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1170/2353] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:00:58 2022] DELETE /identity/v3/users/4260e1ccff74479187f41b324de81350 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:00:59.096769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d4e37-7e90-47b6-8f64-bef3db6e2804 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:59.097517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d4e37-7e90-47b6-8f64-bef3db6e2804 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:59.097517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d4e37-7e90-47b6-8f64-bef3db6e2804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:59.126490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-351d4e37-7e90-47b6-8f64-bef3db6e2804 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:00:59.128446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-351d4e37-7e90-47b6-8f64-bef3db6e2804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:59.214414 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1184/2354] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:00:59.228843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:00:59.232301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:00:59.259729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:00:59.359073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0756e43-5ccf-442e-b055-e5196af0e16e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:00:59.364924 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa482da-1b52-4a3a-8c7c-232798a9a677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:00:59.365893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa482da-1b52-4a3a-8c7c-232798a9a677 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:00:59.367916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa482da-1b52-4a3a-8c7c-232798a9a677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:00:59.368349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa482da-1b52-4a3a-8c7c-232798a9a677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:00:59.395981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa482da-1b52-4a3a-8c7c-232798a9a677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:00:59.398953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa482da-1b52-4a3a-8c7c-232798a9a677 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:00:59.416964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1171/2355] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:01:00.023542 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d4e37-7e90-47b6-8f64-bef3db6e2804 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:00.028584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-351d4e37-7e90-47b6-8f64-bef3db6e2804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:00.087753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d4e37-7e90-47b6-8f64-bef3db6e2804 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:00.096437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:00.098299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:00.099044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:00.099679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] PATH_INFO: `/v3/projects/8a02a78b17c64cdaabd88182ff5d15f4` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:00.102225 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a02a78b17c64cdaabd88182ff5d15f4)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:00.106659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:00.216098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a02a78b17c64cdaabd88182ff5d15f4', 'request_id': 'req-b81d6472-93cc-4613-bffc-87fae0997c81'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.224275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a02a78b17c64cdaabd88182ff5d15f4', 'request_id': 'req-b81d6472-93cc-4613-bffc-87fae0997c81'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.239518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a02a78b17c64cdaabd88182ff5d15f4', 'request_id': 'req-b81d6472-93cc-4613-bffc-87fae0997c81'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.243374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:00.258582 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] The token cache is being invalidate because project 8a02a78b17c64cdaabd88182ff5d15f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:01:00.258903 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.259706 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.261849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1185/2356] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:01:00 2022] DELETE /identity/v3/projects/8a02a78b17c64cdaabd88182ff5d15f4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:01:00.266619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa482da-1b52-4a3a-8c7c-232798a9a677 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:00.278003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa482da-1b52-4a3a-8c7c-232798a9a677 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:00.405942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:00.407155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:00.407535 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:00.407888 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] PATH_INFO: `/v3/users/fbd44ebd4bf84ad89c4f416b09c95481` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:00.409704 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd44ebd4bf84ad89c4f416b09c95481)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:00.413206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:00.493540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd44ebd4bf84ad89c4f416b09c95481'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.514303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd44ebd4bf84ad89c4f416b09c95481'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.515103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd44ebd4bf84ad89c4f416b09c95481'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.531334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd44ebd4bf84ad89c4f416b09c95481'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.542243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a72ca56-c612-4168-ae2d-c348d37fa445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd44ebd4bf84ad89c4f416b09c95481'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:00.555352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1172/2357] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:01:00 2022] DELETE /identity/v3/users/fbd44ebd4bf84ad89c4f416b09c95481 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:01:01.276011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:01.280033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:01.314674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d6472-93cc-4613-bffc-87fae0997c81 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:01.449741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:01.451112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:01.451394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:01.451669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] PATH_INFO: `/v3/projects/ae1d8c9fcc28475f842e32eda4a0351c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:01.454606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1d8c9fcc28475f842e32eda4a0351c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:01.456828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:01.525644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1d8c9fcc28475f842e32eda4a0351c', 'request_id': 'req-d794c190-4186-4076-8917-a9cce365cfa1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:01.537653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1d8c9fcc28475f842e32eda4a0351c', 'request_id': 'req-d794c190-4186-4076-8917-a9cce365cfa1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:01.553345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1d8c9fcc28475f842e32eda4a0351c', 'request_id': 'req-d794c190-4186-4076-8917-a9cce365cfa1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:01.580100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] The token cache is being invalidate because project ae1d8c9fcc28475f842e32eda4a0351c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:01:01.580592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:01.581732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d794c190-4186-4076-8917-a9cce365cfa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:01.584832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1186/2358] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:01:01 2022] DELETE /identity/v3/projects/ae1d8c9fcc28475f842e32eda4a0351c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:01:01.597149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74d8e-59cd-4149-ab8b-3fe5d9c9f8cc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:01.598010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74d8e-59cd-4149-ab8b-3fe5d9c9f8cc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:01.598010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb74d8e-59cd-4149-ab8b-3fe5d9c9f8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:01.634315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9fb74d8e-59cd-4149-ab8b-3fe5d9c9f8cc None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:01:01.636952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9fb74d8e-59cd-4149-ab8b-3fe5d9c9f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:01.682133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:01.767572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1173/2359] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:01:01.783223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ef874-3b2f-478c-be95-8dfe81e7a7ff None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:01.783506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ef874-3b2f-478c-be95-8dfe81e7a7ff None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:01.783805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ef874-3b2f-478c-be95-8dfe81e7a7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:01.809040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-338ef874-3b2f-478c-be95-8dfe81e7a7ff None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:01:01.810534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-338ef874-3b2f-478c-be95-8dfe81e7a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:01.823291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1187/2360] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:01:01.829694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74d8e-59cd-4149-ab8b-3fe5d9c9f8cc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:01.841774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb74d8e-59cd-4149-ab8b-3fe5d9c9f8cc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:01.847494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81e700-cd0a-43f8-b6eb-d979b84a032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:01.848422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e700-cd0a-43f8-b6eb-d979b84a032e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:01.848707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e700-cd0a-43f8-b6eb-d979b84a032e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:01.848985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81e700-cd0a-43f8-b6eb-d979b84a032e admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:01.849770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e700-cd0a-43f8-b6eb-d979b84a032e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:01:01.850081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e700-cd0a-43f8-b6eb-d979b84a032e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:01.851887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81e700-cd0a-43f8-b6eb-d979b84a032e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:01.872719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1174/2361] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:01:01.877574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ef874-3b2f-478c-be95-8dfe81e7a7ff None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:01.890155 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ef874-3b2f-478c-be95-8dfe81e7a7ff None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:01.900553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4830a-b28d-4f7f-b691-5fd936da4458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:01.901918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4830a-b28d-4f7f-b691-5fd936da4458 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:01.902573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4830a-b28d-4f7f-b691-5fd936da4458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:01.903145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4830a-b28d-4f7f-b691-5fd936da4458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:01.904552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4830a-b28d-4f7f-b691-5fd936da4458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:01.908671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4830a-b28d-4f7f-b691-5fd936da4458 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:01.961446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1188/2362] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:01:01 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:01:01.967505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81e700-cd0a-43f8-b6eb-d979b84a032e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:01.988099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81e700-cd0a-43f8-b6eb-d979b84a032e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:02.114070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fd298-97f3-4e48-b282-17d7495dcac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:02.115922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fd298-97f3-4e48-b282-17d7495dcac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:02.116485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fd298-97f3-4e48-b282-17d7495dcac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:02.117061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fd298-97f3-4e48-b282-17d7495dcac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:02.118520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fd298-97f3-4e48-b282-17d7495dcac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:02.122818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fd298-97f3-4e48-b282-17d7495dcac8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:02.164445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1175/2363] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:01:01 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:01:02.171035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4830a-b28d-4f7f-b691-5fd936da4458 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:02.191406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4830a-b28d-4f7f-b691-5fd936da4458 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:02.203035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e778f-8bf8-4e86-b585-954963c51418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:02.204647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e778f-8bf8-4e86-b585-954963c51418 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:02.207053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e778f-8bf8-4e86-b585-954963c51418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:02.207906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e778f-8bf8-4e86-b585-954963c51418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:02.208601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e778f-8bf8-4e86-b585-954963c51418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:02.215676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e778f-8bf8-4e86-b585-954963c51418 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:02.241498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1189/2364] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:01:02.245192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fd298-97f3-4e48-b282-17d7495dcac8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:02.269564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fd298-97f3-4e48-b282-17d7495dcac8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:02.279740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d279d-df26-404b-a6f7-cb0d824af0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:02.281242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d279d-df26-404b-a6f7-cb0d824af0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:02.281735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d279d-df26-404b-a6f7-cb0d824af0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:02.282049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d279d-df26-404b-a6f7-cb0d824af0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:02.282932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d279d-df26-404b-a6f7-cb0d824af0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:02.284668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d279d-df26-404b-a6f7-cb0d824af0c4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:02.304851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1176/2365] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:01:02.312113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e778f-8bf8-4e86-b585-954963c51418 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:02.328761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e778f-8bf8-4e86-b585-954963c51418 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:02.339227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d087c-2756-48d0-9a9f-79790fdb4c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:02.341215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d087c-2756-48d0-9a9f-79790fdb4c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:02.341658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d087c-2756-48d0-9a9f-79790fdb4c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:02.342171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d087c-2756-48d0-9a9f-79790fdb4c97 admin admin] PATH_INFO: `/v3/projects/2e992ca476fc4d99b26615455e574ebe/users/d558c625983b48e3a89b28c2a442a6b7/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:02.373850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d087c-2756-48d0-9a9f-79790fdb4c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e992ca476fc4d99b26615455e574ebe, user_id=d558c625983b48e3a89b28c2a442a6b7, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:02.379655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d087c-2756-48d0-9a9f-79790fdb4c97 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:02.408738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1190/2366] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:01:02 2022] PUT /identity/v3/projects/2e992ca476fc4d99b26615455e574ebe/users/d558c625983b48e3a89b28c2a442a6b7/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:01:02.434143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0523-2247-496b-a557-3cae0beb8db0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:02.434893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0523-2247-496b-a557-3cae0beb8db0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:02.435481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0523-2247-496b-a557-3cae0beb8db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:02.490656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-658c0523-2247-496b-a557-3cae0beb8db0 None None] MFA Rules not processed for user `d558c625983b48e3a89b28c2a442a6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:01:02.493112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-658c0523-2247-496b-a557-3cae0beb8db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:02.643135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1177/2367] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:01:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:01:02.656315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d087c-2756-48d0-9a9f-79790fdb4c97 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:02.658498 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ad9d087c-2756-48d0-9a9f-79790fdb4c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:02.688290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:02.744437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d087c-2756-48d0-9a9f-79790fdb4c97 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:02.754701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e51db-543c-435a-a8bd-c71b0d488ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:02.754958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e51db-543c-435a-a8bd-c71b0d488ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:02.755167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e51db-543c-435a-a8bd-c71b0d488ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:02.755445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e51db-543c-435a-a8bd-c71b0d488ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:02.771137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e51db-543c-435a-a8bd-c71b0d488ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:02.774052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e51db-543c-435a-a8bd-c71b0d488ea5 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:02.794764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1191/2368] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:01:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:01:05.427618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ce51-8a18-41ec-a48a-17cd02598e1c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:05.428511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ce51-8a18-41ec-a48a-17cd02598e1c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:05.428511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ce51-8a18-41ec-a48a-17cd02598e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:05.492783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f624ce51-8a18-41ec-a48a-17cd02598e1c None None] MFA Rules not processed for user `e7a99ccc238943a098833d03c6233413`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:01:05.494612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f624ce51-8a18-41ec-a48a-17cd02598e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:05.515355 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:05.599453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1178/2369] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:01:05.604779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e51db-543c-435a-a8bd-c71b0d488ea5 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:05.606763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-788e51db-543c-435a-a8bd-c71b0d488ea5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:05.739279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e51db-543c-435a-a8bd-c71b0d488ea5 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:05.745516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b8754-d6bc-449c-8896-28cdd6e6a237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:05.746576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b8754-d6bc-449c-8896-28cdd6e6a237 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:05.746855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b8754-d6bc-449c-8896-28cdd6e6a237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:05.747129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b8754-d6bc-449c-8896-28cdd6e6a237 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:05.747853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b8754-d6bc-449c-8896-28cdd6e6a237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:05.750029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b8754-d6bc-449c-8896-28cdd6e6a237 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:05.789149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1192/2370] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:01:05 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:01:05.796273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624ce51-8a18-41ec-a48a-17cd02598e1c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:05.816139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624ce51-8a18-41ec-a48a-17cd02598e1c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:05.911282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf52ec-5206-4bd4-ab6d-83ecbbfd4dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:05.912381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf52ec-5206-4bd4-ab6d-83ecbbfd4dda admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:05.912855 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf52ec-5206-4bd4-ab6d-83ecbbfd4dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:05.913303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf52ec-5206-4bd4-ab6d-83ecbbfd4dda admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:05.914663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf52ec-5206-4bd4-ab6d-83ecbbfd4dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:05.918916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf52ec-5206-4bd4-ab6d-83ecbbfd4dda admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:05.952175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1179/2371] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:01:05 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:01:05.956540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b8754-d6bc-449c-8896-28cdd6e6a237 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:05.973247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b8754-d6bc-449c-8896-28cdd6e6a237 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:05.980020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd56be2-5dfd-41cc-8229-99140b204942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:05.981302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd56be2-5dfd-41cc-8229-99140b204942 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:05.981683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd56be2-5dfd-41cc-8229-99140b204942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:05.982048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd56be2-5dfd-41cc-8229-99140b204942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:05.983463 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd56be2-5dfd-41cc-8229-99140b204942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:05.986799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd56be2-5dfd-41cc-8229-99140b204942 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:06.018742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1193/2372] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 13:01:06.020441 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf52ec-5206-4bd4-ab6d-83ecbbfd4dda admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:06.036065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf52ec-5206-4bd4-ab6d-83ecbbfd4dda admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:06.046848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17089d-50b8-4bd1-ba91-3630d8010a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:06.047801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17089d-50b8-4bd1-ba91-3630d8010a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:06.048087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17089d-50b8-4bd1-ba91-3630d8010a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:06.048368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17089d-50b8-4bd1-ba91-3630d8010a63 admin admin] PATH_INFO: `/v3/projects/fe75e8f202004afabfdf5f4af7d0105a/users/5e205bd557e34b0388c4838c12d55b79/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:06.070618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17089d-50b8-4bd1-ba91-3630d8010a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe75e8f202004afabfdf5f4af7d0105a, user_id=5e205bd557e34b0388c4838c12d55b79, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:06.074126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17089d-50b8-4bd1-ba91-3630d8010a63 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:06.098776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1180/2373] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:01:06 2022] PUT /identity/v3/projects/fe75e8f202004afabfdf5f4af7d0105a/users/5e205bd557e34b0388c4838c12d55b79/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:01:06.103254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd56be2-5dfd-41cc-8229-99140b204942 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:06.119214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd56be2-5dfd-41cc-8229-99140b204942 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:06.205787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56e7eb-5b6e-479d-a2ac-28d78fbaf5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:06.207353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56e7eb-5b6e-479d-a2ac-28d78fbaf5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:06.207849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56e7eb-5b6e-479d-a2ac-28d78fbaf5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:06.208343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56e7eb-5b6e-479d-a2ac-28d78fbaf5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:06.209774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56e7eb-5b6e-479d-a2ac-28d78fbaf5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:06.213048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56e7eb-5b6e-479d-a2ac-28d78fbaf5f5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:06.234292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1194/2374] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:01:06.239725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17089d-50b8-4bd1-ba91-3630d8010a63 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:06.259651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17089d-50b8-4bd1-ba91-3630d8010a63 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:06.269842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07236776-579d-4b21-af2d-23d05ab7c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:06.270731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07236776-579d-4b21-af2d-23d05ab7c958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:06.271156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07236776-579d-4b21-af2d-23d05ab7c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:06.271612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07236776-579d-4b21-af2d-23d05ab7c958 admin admin] PATH_INFO: `/v3/projects/fe75e8f202004afabfdf5f4af7d0105a/users/5e205bd557e34b0388c4838c12d55b79/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:06.274899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07236776-579d-4b21-af2d-23d05ab7c958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe75e8f202004afabfdf5f4af7d0105a, user_id=5e205bd557e34b0388c4838c12d55b79, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:06.281466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07236776-579d-4b21-af2d-23d05ab7c958 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:06.315687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1181/2375] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:01:06 2022] PUT /identity/v3/projects/fe75e8f202004afabfdf5f4af7d0105a/users/5e205bd557e34b0388c4838c12d55b79/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:01:12.570583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1439-5a79-4b87-9ae6-98dc494fcab7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:12.571451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1439-5a79-4b87-9ae6-98dc494fcab7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:12.571451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1439-5a79-4b87-9ae6-98dc494fcab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:12.624921 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ad6e1439-5a79-4b87-9ae6-98dc494fcab7 None None] MFA Rules not processed for user `5e205bd557e34b0388c4838c12d55b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:01:12.627621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ad6e1439-5a79-4b87-9ae6-98dc494fcab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:12.665137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:12.738027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1195/2376] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:01:12.756547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07236776-579d-4b21-af2d-23d05ab7c958 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:12.758616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-07236776-579d-4b21-af2d-23d05ab7c958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:12.851850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:12.864088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07236776-579d-4b21-af2d-23d05ab7c958 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:12.870043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4668b-7a97-443b-8a9e-570f16d37167 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984780a6a8df405dbbb2ba4c46dd841c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:12.871121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4668b-7a97-443b-8a9e-570f16d37167 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:12.871791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4668b-7a97-443b-8a9e-570f16d37167 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:12.872417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4668b-7a97-443b-8a9e-570f16d37167 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:12.979575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4668b-7a97-443b-8a9e-570f16d37167 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:12.982819 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4668b-7a97-443b-8a9e-570f16d37167 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:13.003700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1182/2377] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:01:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:01:13.222146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aa334-e904-417c-9a30-2a33c00c12d7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:13.222606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aa334-e904-417c-9a30-2a33c00c12d7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:13.223146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aa334-e904-417c-9a30-2a33c00c12d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:13.332671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-238aa334-e904-417c-9a30-2a33c00c12d7 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:01:13.335185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-238aa334-e904-417c-9a30-2a33c00c12d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:13.455284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1196/2378] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:01:13.529181 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4668b-7a97-443b-8a9e-570f16d37167 service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:13.529953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87c4668b-7a97-443b-8a9e-570f16d37167 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:13.691194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4668b-7a97-443b-8a9e-570f16d37167 service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:13.700450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a872f8d-5334-4226-8b98-542c187dbb8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:13.701637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a872f8d-5334-4226-8b98-542c187dbb8b service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:13.702016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a872f8d-5334-4226-8b98-542c187dbb8b service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:13.702512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a872f8d-5334-4226-8b98-542c187dbb8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:13.716154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a872f8d-5334-4226-8b98-542c187dbb8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:13.717849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a872f8d-5334-4226-8b98-542c187dbb8b service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:13.727532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1183/2379] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:01:23.451642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=67 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:23.724049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=69 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:24.763642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bad10-0619-4db8-ab2d-3389207f9897 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:24.764287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bad10-0619-4db8-ab2d-3389207f9897 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:24.764287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bad10-0619-4db8-ab2d-3389207f9897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:24.784846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-cc7bad10-0619-4db8-ab2d-3389207f9897 None None] MFA Rules not processed for user `e7a99ccc238943a098833d03c6233413`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:01:24.786344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cc7bad10-0619-4db8-ab2d-3389207f9897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:24.794337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1197/2380] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:01:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:01:27.351281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba617c12-8a57-4637-a200-13a6158ced0a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:27.352161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba617c12-8a57-4637-a200-13a6158ced0a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:27.352161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba617c12-8a57-4637-a200-13a6158ced0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:27.378738 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ba617c12-8a57-4637-a200-13a6158ced0a None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:01:27.380803 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ba617c12-8a57-4637-a200-13a6158ced0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:27.393660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1184/2381] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:01:27.415138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bad10-0619-4db8-ab2d-3389207f9897 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:27.436975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bad10-0619-4db8-ab2d-3389207f9897 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:27.448458 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c011c6-0080-49a1-9185-bd1ee660a87a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:27.449781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c011c6-0080-49a1-9185-bd1ee660a87a service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:27.450373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c011c6-0080-49a1-9185-bd1ee660a87a service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:27.450821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c011c6-0080-49a1-9185-bd1ee660a87a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:27.468614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c011c6-0080-49a1-9185-bd1ee660a87a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:27.471636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c011c6-0080-49a1-9185-bd1ee660a87a service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:27.488862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1198/2382] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:01:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:01:37.369832 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:37.482195 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=9 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:01:59.374637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba617c12-8a57-4637-a200-13a6158ced0a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:59.451960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba617c12-8a57-4637-a200-13a6158ced0a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:59.457044 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:59.457851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:59.458162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:59.458440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] PATH_INFO: `/v3/users/d558c625983b48e3a89b28c2a442a6b7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:59.459641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d558c625983b48e3a89b28c2a442a6b7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:59.462546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:59.524699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd558c625983b48e3a89b28c2a442a6b7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:59.537986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd558c625983b48e3a89b28c2a442a6b7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:59.538887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd558c625983b48e3a89b28c2a442a6b7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:59.549419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd558c625983b48e3a89b28c2a442a6b7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:59.558838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd558c625983b48e3a89b28c2a442a6b7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:01:59.565440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1185/2383] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:01:59 2022] DELETE /identity/v3/users/d558c625983b48e3a89b28c2a442a6b7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:01:59.570302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac82e67-595a-4383-8f09-21d87860588b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:59.570809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac82e67-595a-4383-8f09-21d87860588b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:59.570923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac82e67-595a-4383-8f09-21d87860588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:59.592079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fac82e67-595a-4383-8f09-21d87860588b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:01:59.593303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fac82e67-595a-4383-8f09-21d87860588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:59.663686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1199/2384] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:01:59.673754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:01:59.675843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:01:59.740643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3d9e-dbad-4f1c-b5f4-465249f219ba admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:01:59.744854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c1c70-9799-4bf5-a94a-48fb4d668d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:01:59.745573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c1c70-9799-4bf5-a94a-48fb4d668d08 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:01:59.745854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c1c70-9799-4bf5-a94a-48fb4d668d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:01:59.746154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c1c70-9799-4bf5-a94a-48fb4d668d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:01:59.762442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c1c70-9799-4bf5-a94a-48fb4d668d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:01:59.763957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c1c70-9799-4bf5-a94a-48fb4d668d08 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:01:59.777681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1186/2385] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:00.103322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac82e67-595a-4383-8f09-21d87860588b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:00.105053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fac82e67-595a-4383-8f09-21d87860588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:00.123059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac82e67-595a-4383-8f09-21d87860588b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:00.133311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:00.134009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.134491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.134772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] PATH_INFO: `/v3/projects/2e992ca476fc4d99b26615455e574ebe` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.136281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e992ca476fc4d99b26615455e574ebe)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:00.140863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:00.202762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e992ca476fc4d99b26615455e574ebe', 'request_id': 'req-0baa246e-56c5-41f6-8eaf-32235914b23f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:02:00.216012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e992ca476fc4d99b26615455e574ebe', 'request_id': 'req-0baa246e-56c5-41f6-8eaf-32235914b23f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:02:00.229032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e992ca476fc4d99b26615455e574ebe', 'request_id': 'req-0baa246e-56c5-41f6-8eaf-32235914b23f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:02:00.248377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] The token cache is being invalidate because project 2e992ca476fc4d99b26615455e574ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:02:00.248726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:02:00.249429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0baa246e-56c5-41f6-8eaf-32235914b23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:02:00.257127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1200/2386] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:02:00 2022] DELETE /identity/v3/projects/2e992ca476fc4d99b26615455e574ebe => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:02:00.260178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949c7d-650f-4916-8b40-bf8c19f70e82 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.260670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949c7d-650f-4916-8b40-bf8c19f70e82 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.260945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949c7d-650f-4916-8b40-bf8c19f70e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.290712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c3949c7d-650f-4916-8b40-bf8c19f70e82 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:00.292157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c3949c7d-650f-4916-8b40-bf8c19f70e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:00.320481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:00.379434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1187/2387] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:02:00.388760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be398ecc-b90b-45aa-8f68-befcf316050f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.389091 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be398ecc-b90b-45aa-8f68-befcf316050f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.389312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be398ecc-b90b-45aa-8f68-befcf316050f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.421930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-be398ecc-b90b-45aa-8f68-befcf316050f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:00.423939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-be398ecc-b90b-45aa-8f68-befcf316050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:00.437527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1201/2388] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:02:00.442751 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3949c7d-650f-4916-8b40-bf8c19f70e82 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:00.454576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3949c7d-650f-4916-8b40-bf8c19f70e82 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:00.459428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cc215-dcdb-4713-abaa-d8ba47fc88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:00.460151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc215-dcdb-4713-abaa-d8ba47fc88a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.460439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc215-dcdb-4713-abaa-d8ba47fc88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.460719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc215-dcdb-4713-abaa-d8ba47fc88a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.461474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cc215-dcdb-4713-abaa-d8ba47fc88a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:02:00.461783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cc215-dcdb-4713-abaa-d8ba47fc88a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:00.463483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cc215-dcdb-4713-abaa-d8ba47fc88a6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:00.476331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1188/2389] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:02:00.481072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be398ecc-b90b-45aa-8f68-befcf316050f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:00.498051 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be398ecc-b90b-45aa-8f68-befcf316050f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:00.506816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa977e4-06e9-4dc7-9c3e-c34e049d01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:00.507981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa977e4-06e9-4dc7-9c3e-c34e049d01a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.508467 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa977e4-06e9-4dc7-9c3e-c34e049d01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.508958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa977e4-06e9-4dc7-9c3e-c34e049d01a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.510369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa977e4-06e9-4dc7-9c3e-c34e049d01a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:00.514411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa977e4-06e9-4dc7-9c3e-c34e049d01a2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:00.546445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1202/2390] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:02:00 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:02:00.552671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cc215-dcdb-4713-abaa-d8ba47fc88a6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:00.566524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cc215-dcdb-4713-abaa-d8ba47fc88a6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:00.633348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d931-2802-472a-a6eb-c6f287189808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:00.634250 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d931-2802-472a-a6eb-c6f287189808 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.634616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d931-2802-472a-a6eb-c6f287189808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.634990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d931-2802-472a-a6eb-c6f287189808 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.635895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0d931-2802-472a-a6eb-c6f287189808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:00.638015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0d931-2802-472a-a6eb-c6f287189808 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:00.662570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1189/2391] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:02:00 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:02:00.668442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa977e4-06e9-4dc7-9c3e-c34e049d01a2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:00.681801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa977e4-06e9-4dc7-9c3e-c34e049d01a2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:00.687682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504568d-08bb-409e-ab1b-cc933ca371f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:00.689036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504568d-08bb-409e-ab1b-cc933ca371f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.689410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504568d-08bb-409e-ab1b-cc933ca371f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.689863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504568d-08bb-409e-ab1b-cc933ca371f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.690788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504568d-08bb-409e-ab1b-cc933ca371f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:00.692613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504568d-08bb-409e-ab1b-cc933ca371f0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:00.705070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1203/2392] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:02:00.709736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d931-2802-472a-a6eb-c6f287189808 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:00.722830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d931-2802-472a-a6eb-c6f287189808 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:00.728699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82396322-799a-4b2f-ade1-0a2dd33be1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:00.729472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396322-799a-4b2f-ade1-0a2dd33be1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.729822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396322-799a-4b2f-ade1-0a2dd33be1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.730116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396322-799a-4b2f-ade1-0a2dd33be1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.730924 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82396322-799a-4b2f-ade1-0a2dd33be1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:00.732584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82396322-799a-4b2f-ade1-0a2dd33be1a0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:00.744367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1190/2393] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 13:02:00.750747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504568d-08bb-409e-ab1b-cc933ca371f0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:00.761715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504568d-08bb-409e-ab1b-cc933ca371f0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:00.767076 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cfb83-02c3-4e60-ab7d-45c35d00fc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:00.767935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cfb83-02c3-4e60-ab7d-45c35d00fc35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.768359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cfb83-02c3-4e60-ab7d-45c35d00fc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.768638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cfb83-02c3-4e60-ab7d-45c35d00fc35 admin admin] PATH_INFO: `/v3/projects/834ac53907e54975851947e5f653c688/users/c6bc5146c28948c5859cd9eb3d09e0cf/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.785925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cfb83-02c3-4e60-ab7d-45c35d00fc35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834ac53907e54975851947e5f653c688, user_id=c6bc5146c28948c5859cd9eb3d09e0cf, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:00.788743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cfb83-02c3-4e60-ab7d-45c35d00fc35 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:00.807600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1204/2394] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:02:00 2022] PUT /identity/v3/projects/834ac53907e54975851947e5f653c688/users/c6bc5146c28948c5859cd9eb3d09e0cf/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:02:00.812752 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c90f3-020f-45be-859d-e7c321aa3ed0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:00.813327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c90f3-020f-45be-859d-e7c321aa3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:00.813889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c90f3-020f-45be-859d-e7c321aa3ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:00.837029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c68c90f3-020f-45be-859d-e7c321aa3ed0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:00.838311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c68c90f3-020f-45be-859d-e7c321aa3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:00.916283 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1191/2395] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:02:00.928059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cfb83-02c3-4e60-ab7d-45c35d00fc35 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:00.929955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c52cfb83-02c3-4e60-ab7d-45c35d00fc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:00.960780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:01.036661 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cfb83-02c3-4e60-ab7d-45c35d00fc35 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:01.042466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b2bd-8dbe-4da3-a708-f8af3925a4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:01.043583 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b2bd-8dbe-4da3-a708-f8af3925a4be service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:01.044064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b2bd-8dbe-4da3-a708-f8af3925a4be service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:01.044736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b2bd-8dbe-4da3-a708-f8af3925a4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:01.061579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3b2bd-8dbe-4da3-a708-f8af3925a4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:01.064511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3b2bd-8dbe-4da3-a708-f8af3925a4be service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:01.081763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1205/2396] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:01.896730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47edff-3ad1-4f7e-8bb1-4375e846567b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:01.897230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47edff-3ad1-4f7e-8bb1-4375e846567b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:01.897325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47edff-3ad1-4f7e-8bb1-4375e846567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:01.927312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0b47edff-3ad1-4f7e-8bb1-4375e846567b None None] MFA Rules not processed for user `c6bc5146c28948c5859cd9eb3d09e0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:01.928551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0b47edff-3ad1-4f7e-8bb1-4375e846567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:01.947086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:02.005054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1192/2397] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:02:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:02:02.016834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b2bd-8dbe-4da3-a708-f8af3925a4be service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:02.018421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-97e3b2bd-8dbe-4da3-a708-f8af3925a4be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:02.087829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b2bd-8dbe-4da3-a708-f8af3925a4be service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:02.091754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a899569-8755-4f54-9d6d-b1fe4ad5cca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:02.092420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a899569-8755-4f54-9d6d-b1fe4ad5cca1 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:02.092686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a899569-8755-4f54-9d6d-b1fe4ad5cca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:02.092967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a899569-8755-4f54-9d6d-b1fe4ad5cca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:02.102025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a899569-8755-4f54-9d6d-b1fe4ad5cca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:02.103525 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a899569-8755-4f54-9d6d-b1fe4ad5cca1 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:02.113594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1206/2398] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:02.736705 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47edff-3ad1-4f7e-8bb1-4375e846567b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:02.738705 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0b47edff-3ad1-4f7e-8bb1-4375e846567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:02.751766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47edff-3ad1-4f7e-8bb1-4375e846567b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:02.756148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf4fa2-1f1f-4c58-9d4e-0126d93c790a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:02.756824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4fa2-1f1f-4c58-9d4e-0126d93c790a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:02.757644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4fa2-1f1f-4c58-9d4e-0126d93c790a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:02.757644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4fa2-1f1f-4c58-9d4e-0126d93c790a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:02.759301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62bf4fa2-1f1f-4c58-9d4e-0126d93c790a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:02.923935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf4fa2-1f1f-4c58-9d4e-0126d93c790a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:02.925419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf4fa2-1f1f-4c58-9d4e-0126d93c790a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:02.947335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1193/2399] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:03.023780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a899569-8755-4f54-9d6d-b1fe4ad5cca1 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:03.033278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a899569-8755-4f54-9d6d-b1fe4ad5cca1 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:03.037964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dc092-fdad-40ea-8316-db837ad9ceee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:03.038655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dc092-fdad-40ea-8316-db837ad9ceee service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:03.038941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dc092-fdad-40ea-8316-db837ad9ceee service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:03.039347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dc092-fdad-40ea-8316-db837ad9ceee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:03.041128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6d5dc092-fdad-40ea-8316-db837ad9ceee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:03.055935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dc092-fdad-40ea-8316-db837ad9ceee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:03.057429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dc092-fdad-40ea-8316-db837ad9ceee service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:03.079447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1207/2400] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:03.540424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eaca3-4bc7-494b-8e22-ad6849091d96 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:03.540718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eaca3-4bc7-494b-8e22-ad6849091d96 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:03.541005 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eaca3-4bc7-494b-8e22-ad6849091d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:03.564691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e83eaca3-4bc7-494b-8e22-ad6849091d96 None None] MFA Rules not processed for user `c6bc5146c28948c5859cd9eb3d09e0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:03.565952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e83eaca3-4bc7-494b-8e22-ad6849091d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:03.575231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1194/2401] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:02:13.064404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=49 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:13.559490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=65 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:15.513026 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dc092-fdad-40ea-8316-db837ad9ceee service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:15.523877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dc092-fdad-40ea-8316-db837ad9ceee service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:15.528021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:15.528695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:15.528983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:15.529323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:15.531530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:15.601037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:15.602619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:15.613154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1208/2402] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:17.236936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276062-29e2-4018-b067-e6ce6f690461 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:17.237459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276062-29e2-4018-b067-e6ce6f690461 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:17.237545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83276062-29e2-4018-b067-e6ce6f690461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:17.263611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-83276062-29e2-4018-b067-e6ce6f690461 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:17.266406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83276062-29e2-4018-b067-e6ce6f690461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:17.342397 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1195/2403] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:02:17.370411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:17.372112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:17.452189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d1bcb-42fe-4f45-9752-964583d6398d service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:17.457645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34c475-e1a1-49c0-a07d-286fe832ff3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:17.458206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34c475-e1a1-49c0-a07d-286fe832ff3f service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:17.458392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34c475-e1a1-49c0-a07d-286fe832ff3f service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:17.458665 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34c475-e1a1-49c0-a07d-286fe832ff3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:17.467902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34c475-e1a1-49c0-a07d-286fe832ff3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:17.469534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34c475-e1a1-49c0-a07d-286fe832ff3f service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:17.478437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1209/2404] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:02:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:02:20.861631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276062-29e2-4018-b067-e6ce6f690461 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:20.863433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83276062-29e2-4018-b067-e6ce6f690461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:20.887775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83276062-29e2-4018-b067-e6ce6f690461 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:20.896220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84be1e-053f-42c3-8c0b-a99a6c62bbef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:20.897833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84be1e-053f-42c3-8c0b-a99a6c62bbef service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:20.898331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84be1e-053f-42c3-8c0b-a99a6c62bbef service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:20.899220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84be1e-053f-42c3-8c0b-a99a6c62bbef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:20.903055 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ab84be1e-053f-42c3-8c0b-a99a6c62bbef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:20.985207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84be1e-053f-42c3-8c0b-a99a6c62bbef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:20.986930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84be1e-053f-42c3-8c0b-a99a6c62bbef service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:20.997957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1196/2405] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:27.474569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=62 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:30.992927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=53 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:33.954974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34c475-e1a1-49c0-a07d-286fe832ff3f service swift] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:33.964700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34c475-e1a1-49c0-a07d-286fe832ff3f service swift] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:33.969113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282605ef-fc3c-4f65-9d75-89dc58f4c2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:33.969776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282605ef-fc3c-4f65-9d75-89dc58f4c2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:33.970049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282605ef-fc3c-4f65-9d75-89dc58f4c2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:33.970599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282605ef-fc3c-4f65-9d75-89dc58f4c2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:33.972623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-282605ef-fc3c-4f65-9d75-89dc58f4c2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:33.984962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282605ef-fc3c-4f65-9d75-89dc58f4c2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:33.986730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282605ef-fc3c-4f65-9d75-89dc58f4c2b3 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:33.995809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1210/2406] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:34.119842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e2bbb-9adb-48ff-9ffd-e27f66723553 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.120469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e2bbb-9adb-48ff-9ffd-e27f66723553 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.120469 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e2bbb-9adb-48ff-9ffd-e27f66723553 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.122429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1197/2407] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 13:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 13:02:34.129421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb209b-54d7-4357-a6a2-44eb250306e7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.129941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb209b-54d7-4357-a6a2-44eb250306e7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.130177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb209b-54d7-4357-a6a2-44eb250306e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.169588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e2eb209b-54d7-4357-a6a2-44eb250306e7 None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:34.172507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e2eb209b-54d7-4357-a6a2-44eb250306e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:34.184219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1211/2408] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 13:02:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:02:34.196454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e2bbb-9adb-48ff-9ffd-e27f66723553 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:34.198119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b15e2bbb-9adb-48ff-9ffd-e27f66723553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:34.272852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e2bbb-9adb-48ff-9ffd-e27f66723553 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:34.276668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546439bb-5755-4138-8319-d41c67a031a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984780a6a8df405dbbb2ba4c46dd841c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:34.277335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546439bb-5755-4138-8319-d41c67a031a2 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.277761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546439bb-5755-4138-8319-d41c67a031a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.277869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546439bb-5755-4138-8319-d41c67a031a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.289288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546439bb-5755-4138-8319-d41c67a031a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:34.290975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546439bb-5755-4138-8319-d41c67a031a2 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:34.302970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1198/2409] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:34.397538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83fc58-d342-4259-9a26-950de385c092 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.397828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83fc58-d342-4259-9a26-950de385c092 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.398126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83fc58-d342-4259-9a26-950de385c092 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.399535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1212/2410] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 13:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 13:02:34.404507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6abef-cb37-4798-8951-7dec0fe08e1c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.404801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6abef-cb37-4798-8951-7dec0fe08e1c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.405075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6abef-cb37-4798-8951-7dec0fe08e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.425234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1be6abef-cb37-4798-8951-7dec0fe08e1c None None] MFA Rules not processed for user `688ecef411094633927ffd663ffa1818`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:34.426442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1be6abef-cb37-4798-8951-7dec0fe08e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:34.437615 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1199/2411] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 13:02:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:02:34.454025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83fc58-d342-4259-9a26-950de385c092 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:34.466968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83fc58-d342-4259-9a26-950de385c092 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:34.471445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912e676-f925-44b2-b401-71ee0983bef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:34.472191 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912e676-f925-44b2-b401-71ee0983bef6 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.472482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912e676-f925-44b2-b401-71ee0983bef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.472760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912e676-f925-44b2-b401-71ee0983bef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.480350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912e676-f925-44b2-b401-71ee0983bef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:34.481826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912e676-f925-44b2-b401-71ee0983bef6 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:34.490052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1213/2412] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:34.575780 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b6800-8077-421b-9723-5406e1d1c165 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.576070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b6800-8077-421b-9723-5406e1d1c165 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.576345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b6800-8077-421b-9723-5406e1d1c165 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.577766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1200/2413] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 17 13:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 13:02:34.583608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ae3e-3474-42a6-a1a5-e6844280c00c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.583950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ae3e-3474-42a6-a1a5-e6844280c00c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.584279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ae3e-3474-42a6-a1a5-e6844280c00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.607780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-31f1ae3e-3474-42a6-a1a5-e6844280c00c None None] MFA Rules not processed for user `09a967d14a7243068a016b4677e47234`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:34.609010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-31f1ae3e-3474-42a6-a1a5-e6844280c00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:34.626692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1214/2414] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 17 13:02:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:02:34.640771 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b6800-8077-421b-9723-5406e1d1c165 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:34.654703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b6800-8077-421b-9723-5406e1d1c165 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:34.659275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac2810-81f7-42b9-bea1-7267fc686eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:34.659933 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac2810-81f7-42b9-bea1-7267fc686eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.660214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac2810-81f7-42b9-bea1-7267fc686eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.660510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac2810-81f7-42b9-bea1-7267fc686eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.672274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac2810-81f7-42b9-bea1-7267fc686eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:34.673930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac2810-81f7-42b9-bea1-7267fc686eb5 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:34.685094 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1201/2415] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:34.768016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1ae3e-3474-42a6-a1a5-e6844280c00c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:34.769637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-31f1ae3e-3474-42a6-a1a5-e6844280c00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:34.848580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1ae3e-3474-42a6-a1a5-e6844280c00c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:34.862967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918079d-c95d-4aca-a150-4f50f8037afc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:34.864007 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918079d-c95d-4aca-a150-4f50f8037afc service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:34.864405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918079d-c95d-4aca-a150-4f50f8037afc service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:34.864739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918079d-c95d-4aca-a150-4f50f8037afc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:34.868078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c918079d-c95d-4aca-a150-4f50f8037afc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:34.884720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918079d-c95d-4aca-a150-4f50f8037afc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:34.886396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918079d-c95d-4aca-a150-4f50f8037afc service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:34.897002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1215/2416] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:02:37.897038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac2810-81f7-42b9-bea1-7267fc686eb5 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:37.911473 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac2810-81f7-42b9-bea1-7267fc686eb5 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:37.916972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25d484-47e4-4963-acaa-e43784b4a544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:37.917754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25d484-47e4-4963-acaa-e43784b4a544 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:37.918234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25d484-47e4-4963-acaa-e43784b4a544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:37.918458 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25d484-47e4-4963-acaa-e43784b4a544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:37.920704 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-be25d484-47e4-4963-acaa-e43784b4a544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:37.936176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25d484-47e4-4963-acaa-e43784b4a544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:37.937960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25d484-47e4-4963-acaa-e43784b4a544 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:37.947224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1202/2417] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:02:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:02:38.633468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e15c8-c142-4543-aaf2-12efd43b6048 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:38.633952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e15c8-c142-4543-aaf2-12efd43b6048 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:38.634043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e15c8-c142-4543-aaf2-12efd43b6048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:38.653891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-355e15c8-c142-4543-aaf2-12efd43b6048 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:02:38.655153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-355e15c8-c142-4543-aaf2-12efd43b6048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:02:38.663335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1216/2418] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:02:38.676460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25d484-47e4-4963-acaa-e43784b4a544 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:02:38.690205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25d484-47e4-4963-acaa-e43784b4a544 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:02:38.696098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4889d2-ce29-4028-9d5f-6ae167c6198c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:02:38.696752 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4889d2-ce29-4028-9d5f-6ae167c6198c service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:02:38.697050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4889d2-ce29-4028-9d5f-6ae167c6198c service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:02:38.697326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4889d2-ce29-4028-9d5f-6ae167c6198c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:02:38.705873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4889d2-ce29-4028-9d5f-6ae167c6198c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:02:38.708432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4889d2-ce29-4028-9d5f-6ae167c6198c service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:02:38.719654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1203/2419] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:02:48.648637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=59 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:02:48.716406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=47 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:01.378877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e15c8-c142-4543-aaf2-12efd43b6048 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:03:01.393585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e15c8-c142-4543-aaf2-12efd43b6048 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:03:01.399577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed610d-b49b-4e38-b9b5-780b608020f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:03:01.400242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed610d-b49b-4e38-b9b5-780b608020f4 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:03:01.400547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed610d-b49b-4e38-b9b5-780b608020f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:03:01.400819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed610d-b49b-4e38-b9b5-780b608020f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:03:01.402717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-deed610d-b49b-4e38-b9b5-780b608020f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:03:01.464722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed610d-b49b-4e38-b9b5-780b608020f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:03:01.466393 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed610d-b49b-4e38-b9b5-780b608020f4 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:03:01.476218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1217/2420] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:03:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:03:10.683496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6cc4-a26d-45f0-9955-2f599ebadb1c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:03:10.684028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6cc4-a26d-45f0-9955-2f599ebadb1c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:03:10.684130 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6cc4-a26d-45f0-9955-2f599ebadb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:03:10.702816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-552a6cc4-a26d-45f0-9955-2f599ebadb1c None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:03:10.704037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-552a6cc4-a26d-45f0-9955-2f599ebadb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:03:10.712408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1204/2421] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:03:10.725742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed610d-b49b-4e38-b9b5-780b608020f4 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:03:10.741264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed610d-b49b-4e38-b9b5-780b608020f4 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:03:10.746929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae174-3bbf-4891-a9ff-212a40ce077b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:03:10.747630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae174-3bbf-4891-a9ff-212a40ce077b service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:03:10.748131 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae174-3bbf-4891-a9ff-212a40ce077b service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:03:10.748411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae174-3bbf-4891-a9ff-212a40ce077b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:03:10.759214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ae174-3bbf-4891-a9ff-212a40ce077b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:03:10.760905 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ae174-3bbf-4891-a9ff-212a40ce077b service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:03:10.770013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1218/2422] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:03:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:03:20.697694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:20.766184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=34 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:37.010901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6cc4-a26d-45f0-9955-2f599ebadb1c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:03:37.013287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-552a6cc4-a26d-45f0-9955-2f599ebadb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:03:37.041155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6cc4-a26d-45f0-9955-2f599ebadb1c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:03:37.051083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed7c35-212f-48e7-a94f-65fb8a53ca38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:03:37.052243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed7c35-212f-48e7-a94f-65fb8a53ca38 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:03:37.052754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed7c35-212f-48e7-a94f-65fb8a53ca38 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:03:37.053260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed7c35-212f-48e7-a94f-65fb8a53ca38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:03:37.057271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-67ed7c35-212f-48e7-a94f-65fb8a53ca38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:03:37.134918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed7c35-212f-48e7-a94f-65fb8a53ca38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:03:37.136709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed7c35-212f-48e7-a94f-65fb8a53ca38 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:03:37.147379 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1205/2423] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:03:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:03:47.142604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=28 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:03:53.893545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae174-3bbf-4891-a9ff-212a40ce077b service swift] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:03:53.907943 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae174-3bbf-4891-a9ff-212a40ce077b service swift] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:03:53.915054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed04ae-6995-485a-9e42-eddd5da7c492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:03:53.915713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed04ae-6995-485a-9e42-eddd5da7c492 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:03:53.915987 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed04ae-6995-485a-9e42-eddd5da7c492 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:03:53.916263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed04ae-6995-485a-9e42-eddd5da7c492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:03:53.918461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-69ed04ae-6995-485a-9e42-eddd5da7c492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:03:53.982800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed04ae-6995-485a-9e42-eddd5da7c492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:03:53.984476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed04ae-6995-485a-9e42-eddd5da7c492 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:03:53.994723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1219/2424] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:03:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:04:03.989651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=28 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:10.159604 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed7c35-212f-48e7-a94f-65fb8a53ca38 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:04:10.174699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed7c35-212f-48e7-a94f-65fb8a53ca38 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:04:10.182582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18873201-bea3-495c-b8ee-c55fa2d2a07c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:04:10.183325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18873201-bea3-495c-b8ee-c55fa2d2a07c service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:04:10.183578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18873201-bea3-495c-b8ee-c55fa2d2a07c service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:04:10.183863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18873201-bea3-495c-b8ee-c55fa2d2a07c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:04:10.186319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-18873201-bea3-495c-b8ee-c55fa2d2a07c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:04:10.201433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18873201-bea3-495c-b8ee-c55fa2d2a07c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:04:10.203404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18873201-bea3-495c-b8ee-c55fa2d2a07c service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:04:10.220180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1206/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:04:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:04:20.213461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:04:31.220491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bde15-6b63-43ba-84d7-c47cbb1a3887 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:04:31.221067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bde15-6b63-43ba-84d7-c47cbb1a3887 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:04:31.221367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bde15-6b63-43ba-84d7-c47cbb1a3887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:04:31.247298 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-830bde15-6b63-43ba-84d7-c47cbb1a3887 None None] MFA Rules not processed for user `b75243e37f2342c0a428d39e193e0d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:04:31.248516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-830bde15-6b63-43ba-84d7-c47cbb1a3887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:04:31.257536 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1220/2426] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:04:41.235517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:05:13.663649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18873201-bea3-495c-b8ee-c55fa2d2a07c service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:05:13.681331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18873201-bea3-495c-b8ee-c55fa2d2a07c service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:05:13.687567 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581d221-3cdf-4e44-a704-3201f580c8f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:05:13.688222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581d221-3cdf-4e44-a704-3201f580c8f3 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:05:13.688504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581d221-3cdf-4e44-a704-3201f580c8f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:05:13.688779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581d221-3cdf-4e44-a704-3201f580c8f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:05:13.690795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e581d221-3cdf-4e44-a704-3201f580c8f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:05:13.703544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581d221-3cdf-4e44-a704-3201f580c8f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:05:13.705218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581d221-3cdf-4e44-a704-3201f580c8f3 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:05:13.718808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1207/2427] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:05:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:05:23.711854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:06:10.630930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bde15-6b63-43ba-84d7-c47cbb1a3887 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:06:10.660692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bde15-6b63-43ba-84d7-c47cbb1a3887 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:06:10.667425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6a2c5-083b-4472-b55c-53e5dd5cc84b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:06:10.668230 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a2c5-083b-4472-b55c-53e5dd5cc84b service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:06:10.668465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a2c5-083b-4472-b55c-53e5dd5cc84b service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:06:10.668809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a2c5-083b-4472-b55c-53e5dd5cc84b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:06:10.671211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a2c6a2c5-083b-4472-b55c-53e5dd5cc84b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:06:10.690837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6a2c5-083b-4472-b55c-53e5dd5cc84b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:06:10.692785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6a2c5-083b-4472-b55c-53e5dd5cc84b service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:06:10.711149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1221/2428] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:06:20.701883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:08:09.995413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581d221-3cdf-4e44-a704-3201f580c8f3 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:08:10.006233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581d221-3cdf-4e44-a704-3201f580c8f3 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:08:10.009854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699c39-9da8-472f-84a3-a5e71755c7eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:08:10.010544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699c39-9da8-472f-84a3-a5e71755c7eb service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:08:10.010891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699c39-9da8-472f-84a3-a5e71755c7eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:08:10.011106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45699c39-9da8-472f-84a3-a5e71755c7eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:08:10.022643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45699c39-9da8-472f-84a3-a5e71755c7eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:08:10.024103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45699c39-9da8-472f-84a3-a5e71755c7eb service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:08:10.037696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1208/2429] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:08:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:08:10.045325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6a2c5-083b-4472-b55c-53e5dd5cc84b service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:08:10.055754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6a2c5-083b-4472-b55c-53e5dd5cc84b service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:08:10.059812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e58c7e-e735-428c-b1fa-b6cfe46fb574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:08:10.060500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e58c7e-e735-428c-b1fa-b6cfe46fb574 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:08:10.060746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e58c7e-e735-428c-b1fa-b6cfe46fb574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:08:10.061024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e58c7e-e735-428c-b1fa-b6cfe46fb574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:08:10.071599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e58c7e-e735-428c-b1fa-b6cfe46fb574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:08:10.073094 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e58c7e-e735-428c-b1fa-b6cfe46fb574 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:08:10.105826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1222/2430] 10.222.0.48 () {60 vars in 1396 bytes} [Fri Jun 17 13:08:10 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:08:10.213033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699c39-9da8-472f-84a3-a5e71755c7eb service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:08:10.213934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e58c7e-e735-428c-b1fa-b6cfe46fb574 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:08:10.217187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b6e58c7e-e735-428c-b1fa-b6cfe46fb574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:08:10.230206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e58c7e-e735-428c-b1fa-b6cfe46fb574 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:08:10.231039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45699c39-9da8-472f-84a3-a5e71755c7eb service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:08:10.234420 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1fac9-f195-41c4-9ad4-c9e9b208e233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:08:10.235096 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1fac9-f195-41c4-9ad4-c9e9b208e233 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:08:10.235444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1fac9-f195-41c4-9ad4-c9e9b208e233 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:08:10.235663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1fac9-f195-41c4-9ad4-c9e9b208e233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:08:10.238225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a11369-9853-4ed2-b075-6359eaad1773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:08:10.239000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a11369-9853-4ed2-b075-6359eaad1773 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:08:10.239278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a11369-9853-4ed2-b075-6359eaad1773 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:08:10.239720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a11369-9853-4ed2-b075-6359eaad1773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:08:10.248556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1fac9-f195-41c4-9ad4-c9e9b208e233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:08:10.250543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1fac9-f195-41c4-9ad4-c9e9b208e233 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:08:10.253799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a11369-9853-4ed2-b075-6359eaad1773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:08:10.255497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a11369-9853-4ed2-b075-6359eaad1773 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:08:10.263781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1223/2431] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:08:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:08:10.264639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1fac9-f195-41c4-9ad4-c9e9b208e233 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:08:10.275082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1fac9-f195-41c4-9ad4-c9e9b208e233 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:08:10.280176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bba80-1fcf-4e56-892d-7c89efa712bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:08:10.280975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bba80-1fcf-4e56-892d-7c89efa712bf service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:08:10.281616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bba80-1fcf-4e56-892d-7c89efa712bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:08:10.282123 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bba80-1fcf-4e56-892d-7c89efa712bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:08:10.299676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bba80-1fcf-4e56-892d-7c89efa712bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:08:10.300853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1209/2432] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:08:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:08:10.301439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bba80-1fcf-4e56-892d-7c89efa712bf service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:08:10.301767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a11369-9853-4ed2-b075-6359eaad1773 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:08:10.313164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1224/2433] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:08:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:08:10.314772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bba80-1fcf-4e56-892d-7c89efa712bf service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:08:10.325111 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bba80-1fcf-4e56-892d-7c89efa712bf service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:08:10.325264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a11369-9853-4ed2-b075-6359eaad1773 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:08:10.329462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b736-43fb-43d8-a0f2-e1e898c71622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:08:10.330024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f4ad4-9ca1-4485-adaa-3993092b6975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:08:10.330330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b736-43fb-43d8-a0f2-e1e898c71622 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:08:10.330761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f4ad4-9ca1-4485-adaa-3993092b6975 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:08:10.330902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b736-43fb-43d8-a0f2-e1e898c71622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:08:10.331049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f4ad4-9ca1-4485-adaa-3993092b6975 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:08:10.331234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b736-43fb-43d8-a0f2-e1e898c71622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:08:10.331351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f4ad4-9ca1-4485-adaa-3993092b6975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:08:10.341135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b736-43fb-43d8-a0f2-e1e898c71622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:08:10.343017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b736-43fb-43d8-a0f2-e1e898c71622 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:08:10.345110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d26f4ad4-9ca1-4485-adaa-3993092b6975 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:08:10.367398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1225/2434] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:08:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:08:10.430553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f4ad4-9ca1-4485-adaa-3993092b6975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:08:10.434838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f4ad4-9ca1-4485-adaa-3993092b6975 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:08:10.442239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1210/2435] 10.222.0.48 () {60 vars in 1396 bytes} [Fri Jun 17 13:08:10 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:08:20.348624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=31 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:08:20.437380 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=47 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:10:10.535119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b736-43fb-43d8-a0f2-e1e898c71622 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:10:10.566711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f4ad4-9ca1-4485-adaa-3993092b6975 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:10:10.586794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f4ad4-9ca1-4485-adaa-3993092b6975 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:10:10.587346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b736-43fb-43d8-a0f2-e1e898c71622 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:10:10.590600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8a375-d253-4d54-b29b-b9376074096e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:10:10.591261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8a375-d253-4d54-b29b-b9376074096e service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:10:10.591384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7ad6-eddc-49a3-ad33-c2411e23f385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:10:10.591552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8a375-d253-4d54-b29b-b9376074096e service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:10:10.591839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8a375-d253-4d54-b29b-b9376074096e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:10:10.592093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7ad6-eddc-49a3-ad33-c2411e23f385 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:10:10.592383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7ad6-eddc-49a3-ad33-c2411e23f385 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:10:10.592648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7ad6-eddc-49a3-ad33-c2411e23f385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:10:10.615465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8a375-d253-4d54-b29b-b9376074096e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:10:10.616126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7ad6-eddc-49a3-ad33-c2411e23f385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:10:10.616926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8a375-d253-4d54-b29b-b9376074096e service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:10:10.617916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7ad6-eddc-49a3-ad33-c2411e23f385 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:10:10.646674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1226/2436] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:10:10.646923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1211/2437] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:10:10.764389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8a375-d253-4d54-b29b-b9376074096e service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:10:10.773465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8a375-d253-4d54-b29b-b9376074096e service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:10:10.778539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6f93-645f-455a-a0a0-afcd22052d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:10:10.779231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6f93-645f-455a-a0a0-afcd22052d7a service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:10:10.779516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6f93-645f-455a-a0a0-afcd22052d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:10:10.779796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6f93-645f-455a-a0a0-afcd22052d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:10:10.796060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a6f93-645f-455a-a0a0-afcd22052d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:10:10.797925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a6f93-645f-455a-a0a0-afcd22052d7a service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:10:10.828104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1212/2438] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:10:16.699437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7ad6-eddc-49a3-ad33-c2411e23f385 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:10:16.701034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c6dd7ad6-eddc-49a3-ad33-c2411e23f385 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:10:16.773106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7ad6-eddc-49a3-ad33-c2411e23f385 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:10:16.778853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1104-29ca-4ff2-8c57-757c494b2712 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:10:16.779580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1104-29ca-4ff2-8c57-757c494b2712 service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:10:16.780468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1104-29ca-4ff2-8c57-757c494b2712 service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:10:16.780754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1104-29ca-4ff2-8c57-757c494b2712 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:10:16.789540 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a1104-29ca-4ff2-8c57-757c494b2712 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:10:16.791216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a1104-29ca-4ff2-8c57-757c494b2712 service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:10:16.802218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1227/2439] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:10:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:10:20.825058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=37 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:10:26.797626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=50 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:13:16.342359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6f93-645f-455a-a0a0-afcd22052d7a service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:13:16.344256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-785a6f93-645f-455a-a0a0-afcd22052d7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:13:16.435059 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6f93-645f-455a-a0a0-afcd22052d7a service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:13:16.438917 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99013d1-e4f4-44d5-b126-8eb3a4058e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:13:16.439576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99013d1-e4f4-44d5-b126-8eb3a4058e81 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:13:16.439859 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99013d1-e4f4-44d5-b126-8eb3a4058e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:13:16.440139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99013d1-e4f4-44d5-b126-8eb3a4058e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:13:16.442164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d99013d1-e4f4-44d5-b126-8eb3a4058e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:13:16.452347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99013d1-e4f4-44d5-b126-8eb3a4058e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:13:16.453826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99013d1-e4f4-44d5-b126-8eb3a4058e81 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:13:16.462401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1213/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:13:26.458518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=35 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:10.912162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1104-29ca-4ff2-8c57-757c494b2712 service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:14:10.913894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-243a1104-29ca-4ff2-8c57-757c494b2712 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:10.999432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1104-29ca-4ff2-8c57-757c494b2712 service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:14:11.003683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8298a88-70d6-4a8c-a954-bc4548e5a7e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:14:11.004344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8298a88-70d6-4a8c-a954-bc4548e5a7e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:14:11.004627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8298a88-70d6-4a8c-a954-bc4548e5a7e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:14:11.004931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8298a88-70d6-4a8c-a954-bc4548e5a7e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:14:11.006982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d8298a88-70d6-4a8c-a954-bc4548e5a7e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:11.088404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99013d1-e4f4-44d5-b126-8eb3a4058e81 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:14:11.098685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99013d1-e4f4-44d5-b126-8eb3a4058e81 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:14:11.099505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8298a88-70d6-4a8c-a954-bc4548e5a7e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:14:11.101153 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8298a88-70d6-4a8c-a954-bc4548e5a7e0 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:14:11.102450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2990d8-1850-4ac1-8c2a-f3f8ec444aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:14:11.103156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2990d8-1850-4ac1-8c2a-f3f8ec444aba service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:14:11.103815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2990d8-1850-4ac1-8c2a-f3f8ec444aba service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:14:11.103815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2990d8-1850-4ac1-8c2a-f3f8ec444aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:14:11.105569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fc2990d8-1850-4ac1-8c2a-f3f8ec444aba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:11.120152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2990d8-1850-4ac1-8c2a-f3f8ec444aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:14:11.121593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2990d8-1850-4ac1-8c2a-f3f8ec444aba service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:14:11.124636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1228/2441] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:14:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:14:11.132029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8298a88-70d6-4a8c-a954-bc4548e5a7e0 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:14:11.133438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1214/2442] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:14:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:14:11.140702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2990d8-1850-4ac1-8c2a-f3f8ec444aba service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:14:11.141293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8298a88-70d6-4a8c-a954-bc4548e5a7e0 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:14:11.145201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5357b35-b3b7-40c5-8028-8c85f7a92c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:14:11.145878 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5357b35-b3b7-40c5-8028-8c85f7a92c9a service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:14:11.146301 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5357b35-b3b7-40c5-8028-8c85f7a92c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:14:11.146584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5357b35-b3b7-40c5-8028-8c85f7a92c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:14:11.148630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e5357b35-b3b7-40c5-8028-8c85f7a92c9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:11.149158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2990d8-1850-4ac1-8c2a-f3f8ec444aba service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:14:11.153048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497b4ec-97d9-4dae-a6dc-c64bd9ba26f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:14:11.153640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b4ec-97d9-4dae-a6dc-c64bd9ba26f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:14:11.153926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b4ec-97d9-4dae-a6dc-c64bd9ba26f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:14:11.154234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497b4ec-97d9-4dae-a6dc-c64bd9ba26f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:14:11.163149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497b4ec-97d9-4dae-a6dc-c64bd9ba26f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:14:11.164600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497b4ec-97d9-4dae-a6dc-c64bd9ba26f0 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:14:11.193330 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1215/2443] 10.222.0.48 () {60 vars in 1396 bytes} [Fri Jun 17 13:14:11 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:14:11.207438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:11.225995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5357b35-b3b7-40c5-8028-8c85f7a92c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:14:11.227510 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5357b35-b3b7-40c5-8028-8c85f7a92c9a service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:14:11.237277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1229/2444] 10.222.0.48 () {60 vars in 1396 bytes} [Fri Jun 17 13:14:11 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:14:11.316069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497b4ec-97d9-4dae-a6dc-c64bd9ba26f0 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:14:11.318300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f497b4ec-97d9-4dae-a6dc-c64bd9ba26f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:11.336103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497b4ec-97d9-4dae-a6dc-c64bd9ba26f0 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:14:11.342064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7cbcc-7324-40e8-8db7-01b592095266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:14:11.342847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7cbcc-7324-40e8-8db7-01b592095266 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:14:11.343197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7cbcc-7324-40e8-8db7-01b592095266 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:14:11.343540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7cbcc-7324-40e8-8db7-01b592095266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:14:11.345494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-88f7cbcc-7324-40e8-8db7-01b592095266 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:11.444428 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7cbcc-7324-40e8-8db7-01b592095266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:14:11.445982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7cbcc-7324-40e8-8db7-01b592095266 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:14:11.456113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1216/2445] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:14:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:14:11.917681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5357b35-b3b7-40c5-8028-8c85f7a92c9a service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:14:11.932265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5357b35-b3b7-40c5-8028-8c85f7a92c9a service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:14:11.937652 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f5f7-d8b9-46c1-8396-841b1181001f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:14:11.938456 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f5f7-d8b9-46c1-8396-841b1181001f service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:14:11.938726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f5f7-d8b9-46c1-8396-841b1181001f service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:14:11.939036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f5f7-d8b9-46c1-8396-841b1181001f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:14:11.942620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8e91f5f7-d8b9-46c1-8396-841b1181001f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:12.060349 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91f5f7-d8b9-46c1-8396-841b1181001f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:14:12.062039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91f5f7-d8b9-46c1-8396-841b1181001f service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:14:12.087931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1230/2446] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:14:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:14:13.565078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2114e30-716f-47a5-ae3c-2f61dda7812c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:14:13.565609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2114e30-716f-47a5-ae3c-2f61dda7812c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:14:13.565733 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2114e30-716f-47a5-ae3c-2f61dda7812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:14:13.610766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c2114e30-716f-47a5-ae3c-2f61dda7812c None None] MFA Rules not processed for user `18195083037046bd99166f68690c3dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:14:13.612351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2114e30-716f-47a5-ae3c-2f61dda7812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:13.681515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1217/2447] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:14:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:14:14.487971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f5f7-d8b9-46c1-8396-841b1181001f service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:14:14.499297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f5f7-d8b9-46c1-8396-841b1181001f service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:14:14.503054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6298e-7f45-4945-8206-f1add39334e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:14:14.503720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6298e-7f45-4945-8206-f1add39334e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:14:14.503998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6298e-7f45-4945-8206-f1add39334e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:14:14.504312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6298e-7f45-4945-8206-f1add39334e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:14:14.506272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-50e6298e-7f45-4945-8206-f1add39334e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:14.517714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6298e-7f45-4945-8206-f1add39334e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:14:14.519563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6298e-7f45-4945-8206-f1add39334e4 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:14:14.530443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1231/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:14:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:14:15.429568 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2114e30-716f-47a5-ae3c-2f61dda7812c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:14:15.432582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2114e30-716f-47a5-ae3c-2f61dda7812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:14:15.454140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2114e30-716f-47a5-ae3c-2f61dda7812c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:14:15.461535 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b1282-9db8-40c4-aa6c-0d497d54c553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:14:15.462912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b1282-9db8-40c4-aa6c-0d497d54c553 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:14:15.463522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b1282-9db8-40c4-aa6c-0d497d54c553 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:14:15.463522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b1282-9db8-40c4-aa6c-0d497d54c553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:14:15.475784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b1282-9db8-40c4-aa6c-0d497d54c553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:14:15.477418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b1282-9db8-40c4-aa6c-0d497d54c553 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:14:15.490925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1218/2449] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:14:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:14:24.526764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=55 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:14:25.486615 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:10.905008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6298e-7f45-4945-8206-f1add39334e4 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:15:10.925181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6298e-7f45-4945-8206-f1add39334e4 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:15:10.933015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa59ad1-d9cc-4760-b58a-74bc26bad0bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:15:10.933660 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa59ad1-d9cc-4760-b58a-74bc26bad0bb service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:15:10.933940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa59ad1-d9cc-4760-b58a-74bc26bad0bb service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:15:10.934241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa59ad1-d9cc-4760-b58a-74bc26bad0bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:15:10.936232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1aa59ad1-d9cc-4760-b58a-74bc26bad0bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:15:11.015882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa59ad1-d9cc-4760-b58a-74bc26bad0bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:15:11.017572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa59ad1-d9cc-4760-b58a-74bc26bad0bb service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:15:11.027236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1232/2450] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:15:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:15:11.429056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b1282-9db8-40c4-aa6c-0d497d54c553 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:15:11.440128 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b1282-9db8-40c4-aa6c-0d497d54c553 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:15:11.445167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362de58-bc5b-4f64-810b-59a5c5265154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:15:11.445860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362de58-bc5b-4f64-810b-59a5c5265154 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:15:11.446153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362de58-bc5b-4f64-810b-59a5c5265154 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:15:11.446457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362de58-bc5b-4f64-810b-59a5c5265154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:15:11.448602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f362de58-bc5b-4f64-810b-59a5c5265154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:15:11.461438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362de58-bc5b-4f64-810b-59a5c5265154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:15:11.463011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362de58-bc5b-4f64-810b-59a5c5265154 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:15:11.472927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1219/2451] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:15:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:15:20.646566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa59ad1-d9cc-4760-b58a-74bc26bad0bb service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:15:20.712483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa59ad1-d9cc-4760-b58a-74bc26bad0bb service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:15:20.718573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c407b10-a6ae-49b8-8788-7b8b0be17e8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:15:20.719028 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c407b10-a6ae-49b8-8788-7b8b0be17e8f service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:15:20.719307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c407b10-a6ae-49b8-8788-7b8b0be17e8f service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:15:20.719575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c407b10-a6ae-49b8-8788-7b8b0be17e8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:15:20.721691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1c407b10-a6ae-49b8-8788-7b8b0be17e8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:15:20.733926 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c407b10-a6ae-49b8-8788-7b8b0be17e8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:15:20.735932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c407b10-a6ae-49b8-8788-7b8b0be17e8f service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:15:20.746159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1233/2452] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:15:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:15:21.468462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:15:30.741727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=65 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:18:19.319442 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362de58-bc5b-4f64-810b-59a5c5265154 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:18:19.335385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362de58-bc5b-4f64-810b-59a5c5265154 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:18:19.340408 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905fb86-121f-40d8-a35c-b6af2114522d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:18:19.341118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905fb86-121f-40d8-a35c-b6af2114522d service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:18:19.341410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905fb86-121f-40d8-a35c-b6af2114522d service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:18:19.341679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905fb86-121f-40d8-a35c-b6af2114522d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:18:19.349788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905fb86-121f-40d8-a35c-b6af2114522d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:18:19.351300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905fb86-121f-40d8-a35c-b6af2114522d service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:18:19.360335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1220/2453] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:18:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:18:29.356525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:11.220115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c407b10-a6ae-49b8-8788-7b8b0be17e8f service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:19:11.220946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905fb86-121f-40d8-a35c-b6af2114522d service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:19:11.233293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c407b10-a6ae-49b8-8788-7b8b0be17e8f service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:19:11.235760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905fb86-121f-40d8-a35c-b6af2114522d service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:19:11.239904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5d7a3-30f0-4485-83a9-bcf4320d11cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:19:11.240570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5d7a3-30f0-4485-83a9-bcf4320d11cc service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:19:11.240857 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5d7a3-30f0-4485-83a9-bcf4320d11cc service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:19:11.241145 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5d7a3-30f0-4485-83a9-bcf4320d11cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:19:11.242251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518c15-dba3-4f56-8376-a7062e58679d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:19:11.242911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518c15-dba3-4f56-8376-a7062e58679d service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:19:11.243196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518c15-dba3-4f56-8376-a7062e58679d service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:19:11.243468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518c15-dba3-4f56-8376-a7062e58679d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:19:11.249549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5d7a3-30f0-4485-83a9-bcf4320d11cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:19:11.252037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5d7a3-30f0-4485-83a9-bcf4320d11cc service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:19:11.253156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22518c15-dba3-4f56-8376-a7062e58679d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:19:11.254908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22518c15-dba3-4f56-8376-a7062e58679d service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:19:11.283724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1234/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:19:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:19:11.287833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1221/2455] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:19:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:19:11.336822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5d7a3-30f0-4485-83a9-bcf4320d11cc service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:19:11.338499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2cf5d7a3-30f0-4485-83a9-bcf4320d11cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:19:11.350702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5d7a3-30f0-4485-83a9-bcf4320d11cc service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:19:11.354339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b51a5-f614-4953-b5e6-192b1e3b52f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:19:11.354985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b51a5-f614-4953-b5e6-192b1e3b52f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:19:11.355268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b51a5-f614-4953-b5e6-192b1e3b52f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:19:11.355542 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b51a5-f614-4953-b5e6-192b1e3b52f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:19:11.357728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f98b51a5-f614-4953-b5e6-192b1e3b52f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:19:11.431337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b51a5-f614-4953-b5e6-192b1e3b52f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:19:11.432831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b51a5-f614-4953-b5e6-192b1e3b52f8 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:19:11.442652 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1235/2456] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:19:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:19:12.153085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518c15-dba3-4f56-8376-a7062e58679d service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:19:12.165657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518c15-dba3-4f56-8376-a7062e58679d service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:19:12.170791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f41ac9-88a9-4d05-8a33-af74fa4ac8f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:19:12.171806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f41ac9-88a9-4d05-8a33-af74fa4ac8f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:19:12.172079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f41ac9-88a9-4d05-8a33-af74fa4ac8f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:19:12.172526 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f41ac9-88a9-4d05-8a33-af74fa4ac8f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:19:12.183487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f41ac9-88a9-4d05-8a33-af74fa4ac8f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:19:12.184966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f41ac9-88a9-4d05-8a33-af74fa4ac8f7 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:19:12.195238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1222/2457] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:19:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:19:21.437779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=46 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:19:22.190802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=19 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:11.212637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b51a5-f614-4953-b5e6-192b1e3b52f8 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:11.232342 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b51a5-f614-4953-b5e6-192b1e3b52f8 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:11.236690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b2a24-7bd5-4efb-a105-1f48f2d9a6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:11.237344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2a24-7bd5-4efb-a105-1f48f2d9a6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:11.237622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2a24-7bd5-4efb-a105-1f48f2d9a6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:11.237899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2a24-7bd5-4efb-a105-1f48f2d9a6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:11.261069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b2a24-7bd5-4efb-a105-1f48f2d9a6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:11.262587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b2a24-7bd5-4efb-a105-1f48f2d9a6a6 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:11.291587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1236/2458] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:20:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:20:11.755327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f41ac9-88a9-4d05-8a33-af74fa4ac8f7 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:11.775923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f41ac9-88a9-4d05-8a33-af74fa4ac8f7 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:11.780326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b86e1-25b5-4987-b798-2d190985640b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:11.780992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b86e1-25b5-4987-b798-2d190985640b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:11.781275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b86e1-25b5-4987-b798-2d190985640b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:11.781555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b86e1-25b5-4987-b798-2d190985640b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:11.790619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b86e1-25b5-4987-b798-2d190985640b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:11.792078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b86e1-25b5-4987-b798-2d190985640b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:11.819608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1223/2459] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:20:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:20:14.091480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b2a24-7bd5-4efb-a105-1f48f2d9a6a6 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:14.101217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b2a24-7bd5-4efb-a105-1f48f2d9a6a6 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:14.104994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62c57-ebc2-4255-b1c9-60897aaecb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:14.105650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62c57-ebc2-4255-b1c9-60897aaecb97 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:14.105953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62c57-ebc2-4255-b1c9-60897aaecb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:14.106607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62c57-ebc2-4255-b1c9-60897aaecb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:14.117702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd62c57-ebc2-4255-b1c9-60897aaecb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:14.119236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd62c57-ebc2-4255-b1c9-60897aaecb97 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:14.130451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1237/2460] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:20:15.770025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b86e1-25b5-4987-b798-2d190985640b service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:15.781427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b86e1-25b5-4987-b798-2d190985640b service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:15.786818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130effc-b92a-467e-b8a6-a90fd80489c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:15.787488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130effc-b92a-467e-b8a6-a90fd80489c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:15.787774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130effc-b92a-467e-b8a6-a90fd80489c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:15.788049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130effc-b92a-467e-b8a6-a90fd80489c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:15.800313 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130effc-b92a-467e-b8a6-a90fd80489c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:15.801758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130effc-b92a-467e-b8a6-a90fd80489c5 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:15.813222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1224/2461] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:20:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:20:16.464695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62c57-ebc2-4255-b1c9-60897aaecb97 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:16.474624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62c57-ebc2-4255-b1c9-60897aaecb97 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:16.479032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:16.479987 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:16.480272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:16.480545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:16.483010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:20:16.573543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:16.575128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:16.597709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1238/2462] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:20:20.623941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130effc-b92a-467e-b8a6-a90fd80489c5 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:20.626082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9130effc-b92a-467e-b8a6-a90fd80489c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:20:20.693496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130effc-b92a-467e-b8a6-a90fd80489c5 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:20.703293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e01c0-5b57-4f85-bd93-a52495592bb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:20.703989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e01c0-5b57-4f85-bd93-a52495592bb4 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:20.704271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e01c0-5b57-4f85-bd93-a52495592bb4 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:20.704545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e01c0-5b57-4f85-bd93-a52495592bb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:20.706457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2a3e01c0-5b57-4f85-bd93-a52495592bb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:20:20.718454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e01c0-5b57-4f85-bd93-a52495592bb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:20.720051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e01c0-5b57-4f85-bd93-a52495592bb4 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:20.730297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1225/2463] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:20:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:20:23.851413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:23.852834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:20:23.887516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d50da-bff8-4f85-a636-048c9604b45b service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:23.898569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:23.898569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:23.899578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:23.899578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] PATH_INFO: `/v3/users/18195083037046bd99166f68690c3dce` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:23.900325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18195083037046bd99166f68690c3dce)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:23.902341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:23.946628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:23.953391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18195083037046bd99166f68690c3dce'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:23.954263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18195083037046bd99166f68690c3dce'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:23.955037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18195083037046bd99166f68690c3dce'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:23.969427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18195083037046bd99166f68690c3dce'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:23.978885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18195083037046bd99166f68690c3dce'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:23.997511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1239/2464] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:20:23 2022] DELETE /identity/v3/users/18195083037046bd99166f68690c3dce => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:20:24.442562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e01c0-5b57-4f85-bd93-a52495592bb4 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:24.455043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e01c0-5b57-4f85-bd93-a52495592bb4 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:24.529916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:24.530943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:24.531326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:24.531703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] PATH_INFO: `/v3/projects/73bf442df39b4f5cbc18f571a0596f10` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:24.533214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bf442df39b4f5cbc18f571a0596f10)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:24.538618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:24.588624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bf442df39b4f5cbc18f571a0596f10', 'request_id': 'req-f6b7907c-6b14-461d-9caf-6358bc3c870f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.590710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:24.595061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bf442df39b4f5cbc18f571a0596f10', 'request_id': 'req-f6b7907c-6b14-461d-9caf-6358bc3c870f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.602518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bf442df39b4f5cbc18f571a0596f10', 'request_id': 'req-f6b7907c-6b14-461d-9caf-6358bc3c870f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.617465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] The token cache is being invalidate because project 73bf442df39b4f5cbc18f571a0596f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:20:24.617753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.618412 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.620003 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1226/2465] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:20:24 2022] DELETE /identity/v3/projects/73bf442df39b4f5cbc18f571a0596f10 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:20:24.624083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:24.625598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:20:24.639549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab24fc3-b563-4a57-9a9c-73690148907d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:24.696465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:24.697362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:24.697647 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:24.697923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] PATH_INFO: `/v3/users/2f7cdf18ba2b4dc4a6cbf1be375071c1` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:24.712292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7cdf18ba2b4dc4a6cbf1be375071c1)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:24.714369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:24.762745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7cdf18ba2b4dc4a6cbf1be375071c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.763389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7cdf18ba2b4dc4a6cbf1be375071c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.764036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7cdf18ba2b4dc4a6cbf1be375071c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.770959 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7cdf18ba2b4dc4a6cbf1be375071c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.780007 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7cdf18ba2b4dc4a6cbf1be375071c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:24.797057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1240/2466] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:20:24 2022] DELETE /identity/v3/users/2f7cdf18ba2b4dc4a6cbf1be375071c1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:20:24.980320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:24.982343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:20:24.997649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7907c-6b14-461d-9caf-6358bc3c870f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:25.057452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:25.058349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:25.058606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:25.058889 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] PATH_INFO: `/v3/projects/5f6d8de1913b42cdb1bb37da5c48716b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:25.070317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6d8de1913b42cdb1bb37da5c48716b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:25.078822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:25.135212 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6d8de1913b42cdb1bb37da5c48716b', 'request_id': 'req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:25.140639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6d8de1913b42cdb1bb37da5c48716b', 'request_id': 'req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:25.147798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6d8de1913b42cdb1bb37da5c48716b', 'request_id': 'req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:25.161538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] The token cache is being invalidate because project 5f6d8de1913b42cdb1bb37da5c48716b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:20:25.161835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:25.162594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:20:25.164147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1227/2467] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:20:24 2022] DELETE /identity/v3/projects/5f6d8de1913b42cdb1bb37da5c48716b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:20:25.651831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:20:25.654279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:20:25.693158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:25.749509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092746-ba33-4530-9e6f-3888bf4c1dd9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:20:25.829967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:20:25.830824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:20:25.831255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:20:25.831562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:20:25.833831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:20:25.845147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:20:25.846922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:20:25.857513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1241/2468] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:20:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:20:35.162414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=61,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:20:35.852600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=47 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:23:26.342872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:23:26.344461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:23:26.426387 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07d98b-00cc-48d2-b0cf-f2275291b4c3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:23:26.430111 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:23:26.430794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:23:26.431081 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:23:26.431359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:23:26.433179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:23:26.445503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:23:26.447006 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:23:26.456350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1228/2469] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:23:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:23:36.452386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=35 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:11.027478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:24:11.029866 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:24:11.147482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbc97d-a984-4988-9c39-5ef71fbd7a8f service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:24:11.154810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5426-e305-43f6-b9d7-c0a72a5c110d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:24:11.155468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5426-e305-43f6-b9d7-c0a72a5c110d service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:24:11.155755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5426-e305-43f6-b9d7-c0a72a5c110d service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:24:11.156041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5426-e305-43f6-b9d7-c0a72a5c110d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:24:11.158211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-214d5426-e305-43f6-b9d7-c0a72a5c110d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:24:11.226507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d5426-e305-43f6-b9d7-c0a72a5c110d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:24:11.228231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d5426-e305-43f6-b9d7-c0a72a5c110d service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:24:11.257171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1242/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:24:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:24:11.452138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:24:11.453762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:24:11.549093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9876a-c17c-4afa-be36-1f35abc794d3 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:24:11.553670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e04a6-5995-40ea-a44b-fae08a8b19e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:24:11.554361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e04a6-5995-40ea-a44b-fae08a8b19e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:24:11.554644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e04a6-5995-40ea-a44b-fae08a8b19e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:24:11.554921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e04a6-5995-40ea-a44b-fae08a8b19e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:24:11.556960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4f6e04a6-5995-40ea-a44b-fae08a8b19e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:24:11.631343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e04a6-5995-40ea-a44b-fae08a8b19e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:24:11.632802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e04a6-5995-40ea-a44b-fae08a8b19e7 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:24:11.642656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1229/2471] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:24:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:24:11.703996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5426-e305-43f6-b9d7-c0a72a5c110d service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:24:11.713671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5426-e305-43f6-b9d7-c0a72a5c110d service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:24:11.718558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf45f1e-ee39-4d9e-9f37-b22e40ed6553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:24:11.719200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf45f1e-ee39-4d9e-9f37-b22e40ed6553 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:24:11.719481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf45f1e-ee39-4d9e-9f37-b22e40ed6553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:24:11.719747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf45f1e-ee39-4d9e-9f37-b22e40ed6553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:24:11.721967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fbf45f1e-ee39-4d9e-9f37-b22e40ed6553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:24:11.782890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:11.805267 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf45f1e-ee39-4d9e-9f37-b22e40ed6553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:24:11.806721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf45f1e-ee39-4d9e-9f37-b22e40ed6553 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:24:11.816222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1243/2472] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:24:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:24:12.495065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e04a6-5995-40ea-a44b-fae08a8b19e7 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:24:12.509877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e04a6-5995-40ea-a44b-fae08a8b19e7 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:24:12.517503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:24:12.518254 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:24:12.518534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:24:12.518815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:24:12.520639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:24:12.610664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:24:12.612278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:24:12.621824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:12.632743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1230/2473] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:24:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:24:15.027417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf45f1e-ee39-4d9e-9f37-b22e40ed6553 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:24:15.046217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf45f1e-ee39-4d9e-9f37-b22e40ed6553 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:24:15.052949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7bf61-0930-455b-8432-8ae645613e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:24:15.054161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7bf61-0930-455b-8432-8ae645613e9d service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:24:15.054640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7bf61-0930-455b-8432-8ae645613e9d service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:24:15.055144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7bf61-0930-455b-8432-8ae645613e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:24:15.057619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-25c7bf61-0930-455b-8432-8ae645613e9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:24:15.080847 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7bf61-0930-455b-8432-8ae645613e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:24:15.084397 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7bf61-0930-455b-8432-8ae645613e9d service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:24:15.110742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1244/2474] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:24:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:24:22.630279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:24:25.103283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=14 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:12.297165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:25:12.299322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:25:12.314800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03db467-655f-4be1-bae3-d597e7e4a2b6 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:25:12.321649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ac6a1-f362-4cbe-bf61-110cb1a8e355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:25:12.322915 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ac6a1-f362-4cbe-bf61-110cb1a8e355 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:25:12.323220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ac6a1-f362-4cbe-bf61-110cb1a8e355 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:25:12.323487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ac6a1-f362-4cbe-bf61-110cb1a8e355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:25:12.325425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-834ac6a1-f362-4cbe-bf61-110cb1a8e355 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:25:12.401852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ac6a1-f362-4cbe-bf61-110cb1a8e355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:25:12.403543 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ac6a1-f362-4cbe-bf61-110cb1a8e355 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:25:12.412907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1231/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:25:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:25:14.608126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7bf61-0930-455b-8432-8ae645613e9d service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:25:14.618374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7bf61-0930-455b-8432-8ae645613e9d service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:25:14.623166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:25:14.623860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:25:14.624125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:25:14.624422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:25:14.626500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:25:14.641962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:25:14.643551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:25:14.656083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1245/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:25:15.907148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ac6a1-f362-4cbe-bf61-110cb1a8e355 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:25:15.917425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ac6a1-f362-4cbe-bf61-110cb1a8e355 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:25:15.921909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844bc50-01ee-4a4a-ae12-afe01ad658bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:25:15.922637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844bc50-01ee-4a4a-ae12-afe01ad658bc service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:25:15.922915 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844bc50-01ee-4a4a-ae12-afe01ad658bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:25:15.923183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844bc50-01ee-4a4a-ae12-afe01ad658bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:25:15.925369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c844bc50-01ee-4a4a-ae12-afe01ad658bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:25:15.940681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844bc50-01ee-4a4a-ae12-afe01ad658bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:25:15.942164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844bc50-01ee-4a4a-ae12-afe01ad658bc service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:25:15.953866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1232/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:25:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:25:24.650643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:25.948554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=39 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:25:32.624052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:25:32.625601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:25:32.640770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbfec9-d92a-45eb-b299-f10bed50ba34 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:25:32.647362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389e6b8-493c-4c2b-99ab-750a264ee918 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:25:32.648015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389e6b8-493c-4c2b-99ab-750a264ee918 service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:25:32.648404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389e6b8-493c-4c2b-99ab-750a264ee918 service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:25:32.648668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389e6b8-493c-4c2b-99ab-750a264ee918 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:25:32.657777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389e6b8-493c-4c2b-99ab-750a264ee918 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:25:32.659444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389e6b8-493c-4c2b-99ab-750a264ee918 service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:25:32.670068 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1246/2478] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:25:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:25:42.665792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:15.422856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03f8a-7e8b-4644-ad81-6308763f9263 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:26:15.423731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03f8a-7e8b-4644-ad81-6308763f9263 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:26:15.424173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03f8a-7e8b-4644-ad81-6308763f9263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:26:15.555338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a5e03f8a-7e8b-4644-ad81-6308763f9263 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:26:15.556822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a5e03f8a-7e8b-4644-ad81-6308763f9263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:26:15.653497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1233/2479] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 13:26:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:26:15.707127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389e6b8-493c-4c2b-99ab-750a264ee918 service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:26:15.708723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4389e6b8-493c-4c2b-99ab-750a264ee918 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:26:15.809482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389e6b8-493c-4c2b-99ab-750a264ee918 service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:26:15.815473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcba4d-a23e-4d1e-84ef-063a5db13261 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:26:15.816146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcba4d-a23e-4d1e-84ef-063a5db13261 service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:26:15.816429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcba4d-a23e-4d1e-84ef-063a5db13261 service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:26:15.816707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcba4d-a23e-4d1e-84ef-063a5db13261 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:26:15.828260 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcba4d-a23e-4d1e-84ef-063a5db13261 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:26:15.831511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcba4d-a23e-4d1e-84ef-063a5db13261 service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:26:15.842277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1247/2480] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:26:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:26:16.468035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e03f8a-7e8b-4644-ad81-6308763f9263 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:26:16.478962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e03f8a-7e8b-4644-ad81-6308763f9263 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:26:16.486824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609ea8b-be90-49e2-940b-0e8c721e4d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:26:16.488232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609ea8b-be90-49e2-940b-0e8c721e4d7e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:26:16.488756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609ea8b-be90-49e2-940b-0e8c721e4d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:26:16.489268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609ea8b-be90-49e2-940b-0e8c721e4d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:26:16.491847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7609ea8b-be90-49e2-940b-0e8c721e4d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:26:16.585110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609ea8b-be90-49e2-940b-0e8c721e4d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:26:16.586814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609ea8b-be90-49e2-940b-0e8c721e4d7e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:26:16.599322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1234/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:26:25.838982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=41 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:26:26.592333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=74 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:28:31.330140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcba4d-a23e-4d1e-84ef-063a5db13261 service swift] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:28:31.340605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcba4d-a23e-4d1e-84ef-063a5db13261 service swift] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:28:31.345469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0704b7-353b-4d5d-9d42-763cbd3e5944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:28:31.346136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0704b7-353b-4d5d-9d42-763cbd3e5944 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:28:31.346425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0704b7-353b-4d5d-9d42-763cbd3e5944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:28:31.346698 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0704b7-353b-4d5d-9d42-763cbd3e5944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:28:31.355081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0704b7-353b-4d5d-9d42-763cbd3e5944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:28:31.356831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0704b7-353b-4d5d-9d42-763cbd3e5944 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:28:31.365204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1248/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:28:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:28:41.361335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:11.724631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609ea8b-be90-49e2-940b-0e8c721e4d7e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:29:11.744023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609ea8b-be90-49e2-940b-0e8c721e4d7e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:29:11.752018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804213-5a19-48a0-b710-6436ed27d8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:29:11.752675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804213-5a19-48a0-b710-6436ed27d8b0 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:29:11.752989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804213-5a19-48a0-b710-6436ed27d8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:29:11.753267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804213-5a19-48a0-b710-6436ed27d8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:29:11.762449 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a804213-5a19-48a0-b710-6436ed27d8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:29:11.764130 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a804213-5a19-48a0-b710-6436ed27d8b0 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:29:11.794228 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1235/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:29:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:29:12.199849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0704b7-353b-4d5d-9d42-763cbd3e5944 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:29:12.218475 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0704b7-353b-4d5d-9d42-763cbd3e5944 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:29:12.225619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c5e1-2213-4ae1-8064-8c92fd13b0ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:29:12.226309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c5e1-2213-4ae1-8064-8c92fd13b0ca service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:29:12.226678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c5e1-2213-4ae1-8064-8c92fd13b0ca service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:29:12.226942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c5e1-2213-4ae1-8064-8c92fd13b0ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:29:12.235878 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584c5e1-2213-4ae1-8064-8c92fd13b0ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:29:12.237501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584c5e1-2213-4ae1-8064-8c92fd13b0ca service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:29:12.265737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1249/2484] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:29:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:29:21.791533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=13 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:29:22.263085 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=13 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:12.033825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804213-5a19-48a0-b710-6436ed27d8b0 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:12.074613 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804213-5a19-48a0-b710-6436ed27d8b0 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:12.081187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69fd7e-d3f5-4484-996f-a8df57751dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:12.081842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69fd7e-d3f5-4484-996f-a8df57751dbd service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:12.082263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69fd7e-d3f5-4484-996f-a8df57751dbd service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:12.082554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69fd7e-d3f5-4484-996f-a8df57751dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:12.091874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69fd7e-d3f5-4484-996f-a8df57751dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:12.093541 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69fd7e-d3f5-4484-996f-a8df57751dbd service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:12.124554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1236/2485] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:14.210365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c5e1-2213-4ae1-8064-8c92fd13b0ca service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:14.235043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c5e1-2213-4ae1-8064-8c92fd13b0ca service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:14.239150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a751b-7048-4e78-b2ca-fbf8262ab2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:14.239822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a751b-7048-4e78-b2ca-fbf8262ab2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:14.240659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a751b-7048-4e78-b2ca-fbf8262ab2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:14.240940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a751b-7048-4e78-b2ca-fbf8262ab2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:14.253754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a751b-7048-4e78-b2ca-fbf8262ab2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:14.255770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a751b-7048-4e78-b2ca-fbf8262ab2a4 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:14.271636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1250/2486] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:14.398123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4c74-8f4a-46cb-a571-14511476b3c2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:14.398697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4c74-8f4a-46cb-a571-14511476b3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:14.398697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4c74-8f4a-46cb-a571-14511476b3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:14.436108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0d9c4c74-8f4a-46cb-a571-14511476b3c2 None None] MFA Rules not processed for user `8bfbd9324f8040c496a83eb599ca80c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:30:14.437320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0d9c4c74-8f4a-46cb-a571-14511476b3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:30:14.445287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1237/2487] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:30:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:30:14.482556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a751b-7048-4e78-b2ca-fbf8262ab2a4 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:14.483950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-411a751b-7048-4e78-b2ca-fbf8262ab2a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:30:14.565129 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a751b-7048-4e78-b2ca-fbf8262ab2a4 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:14.568651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf44a50-760c-459f-a0fd-e60894c04c47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984780a6a8df405dbbb2ba4c46dd841c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:14.569298 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf44a50-760c-459f-a0fd-e60894c04c47 service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:14.569598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf44a50-760c-459f-a0fd-e60894c04c47 service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:14.569873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf44a50-760c-459f-a0fd-e60894c04c47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:14.581261 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf44a50-760c-459f-a0fd-e60894c04c47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:14.582793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf44a50-760c-459f-a0fd-e60894c04c47 service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:14.594381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1251/2488] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:15.121190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c4c74-8f4a-46cb-a571-14511476b3c2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:15.130744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c4c74-8f4a-46cb-a571-14511476b3c2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:15.134594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:15.135238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:15.135520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:15.135765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:15.137504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:30:15.147328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:15.148849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:15.158726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1238/2489] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:15.446024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf44a50-760c-459f-a0fd-e60894c04c47 service glance] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:15.456297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf44a50-760c-459f-a0fd-e60894c04c47 service glance] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:15.460937 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23c75f-4f1b-4e78-8c82-14be612b6bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:15.462621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23c75f-4f1b-4e78-8c82-14be612b6bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:15.463516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23c75f-4f1b-4e78-8c82-14be612b6bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:15.464120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23c75f-4f1b-4e78-8c82-14be612b6bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:15.487712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23c75f-4f1b-4e78-8c82-14be612b6bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:15.489541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23c75f-4f1b-4e78-8c82-14be612b6bb7 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:15.500990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1252/2490] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:15.510863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:15.512291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:30:15.530341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9ba19-c761-46f2-9750-6e0041e4ca48 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:15.552972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237568c4-be8d-44eb-a5a0-f46f17954360 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:15.555608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237568c4-be8d-44eb-a5a0-f46f17954360 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:15.555973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237568c4-be8d-44eb-a5a0-f46f17954360 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:15.556267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237568c4-be8d-44eb-a5a0-f46f17954360 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:15.559215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-237568c4-be8d-44eb-a5a0-f46f17954360 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:30:15.575204 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237568c4-be8d-44eb-a5a0-f46f17954360 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:15.576830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237568c4-be8d-44eb-a5a0-f46f17954360 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:15.588806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1239/2491] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:18.341185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23c75f-4f1b-4e78-8c82-14be612b6bb7 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:18.365203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23c75f-4f1b-4e78-8c82-14be612b6bb7 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:18.373723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac3951-d190-4a3e-9bf2-e647176ee823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:18.374732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac3951-d190-4a3e-9bf2-e647176ee823 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:18.375176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac3951-d190-4a3e-9bf2-e647176ee823 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:18.376012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac3951-d190-4a3e-9bf2-e647176ee823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:18.393132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac3951-d190-4a3e-9bf2-e647176ee823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:18.395118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac3951-d190-4a3e-9bf2-e647176ee823 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:18.409753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1253/2492] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:24.440614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237568c4-be8d-44eb-a5a0-f46f17954360 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:24.467756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237568c4-be8d-44eb-a5a0-f46f17954360 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:24.475638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32903e-39b7-41db-a82f-2c5c215913ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:24.476949 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32903e-39b7-41db-a82f-2c5c215913ef service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:24.477308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32903e-39b7-41db-a82f-2c5c215913ef service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:24.477789 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32903e-39b7-41db-a82f-2c5c215913ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:24.481477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6e32903e-39b7-41db-a82f-2c5c215913ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:30:24.522838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32903e-39b7-41db-a82f-2c5c215913ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:24.524558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32903e-39b7-41db-a82f-2c5c215913ef service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:24.536061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1240/2493] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:28.404803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=58 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:28.591031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac3951-d190-4a3e-9bf2-e647176ee823 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:28.611702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac3951-d190-4a3e-9bf2-e647176ee823 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:28.617882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:28.618723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:28.619084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:28.619490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:28.621596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:30:28.634844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:28.636825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:28.648664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1254/2494] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:34.531116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=59 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:36.621977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32903e-39b7-41db-a82f-2c5c215913ef service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:30:36.715682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32903e-39b7-41db-a82f-2c5c215913ef service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:30:36.721196 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336bc92-4cd4-4bc7-b1e0-8e1d89878d44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:30:36.721858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bc92-4cd4-4bc7-b1e0-8e1d89878d44 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:30:36.722165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bc92-4cd4-4bc7-b1e0-8e1d89878d44 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:30:36.722446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336bc92-4cd4-4bc7-b1e0-8e1d89878d44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:30:36.724490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e336bc92-4cd4-4bc7-b1e0-8e1d89878d44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:30:36.749466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336bc92-4cd4-4bc7-b1e0-8e1d89878d44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:30:36.751112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336bc92-4cd4-4bc7-b1e0-8e1d89878d44 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:30:36.763474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1241/2495] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:30:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:30:38.643562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=9 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:30:46.757553 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=41 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:13.552982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:32:13.555632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:32:13.569696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ab698-a356-48e8-824f-4cc181f2577f service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:32:13.574280 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f573bc-7e63-4d86-a9e4-93c324cfae8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:32:13.574925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f573bc-7e63-4d86-a9e4-93c324cfae8a service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:32:13.575570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f573bc-7e63-4d86-a9e4-93c324cfae8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:32:13.575570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f573bc-7e63-4d86-a9e4-93c324cfae8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:32:13.585066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f573bc-7e63-4d86-a9e4-93c324cfae8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:32:13.586562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f573bc-7e63-4d86-a9e4-93c324cfae8a service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:32:13.595624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1255/2496] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:32:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:32:16.272075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89d750-0756-446f-ac0b-e6240f08a720 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:32:16.272668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89d750-0756-446f-ac0b-e6240f08a720 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:32:16.272668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89d750-0756-446f-ac0b-e6240f08a720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:32:16.301455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2e89d750-0756-446f-ac0b-e6240f08a720 None None] MFA Rules not processed for user `847c39439e874e68b72e07c311a53bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:32:16.302708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2e89d750-0756-446f-ac0b-e6240f08a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:32:16.311165 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1242/2497] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:32:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:32:16.635440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f573bc-7e63-4d86-a9e4-93c324cfae8a service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:32:16.645478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f573bc-7e63-4d86-a9e4-93c324cfae8a service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:32:16.649428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e29e4f-045e-43a2-9577-c5f99e51aadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:32:16.650050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29e4f-045e-43a2-9577-c5f99e51aadf service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:32:16.650363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29e4f-045e-43a2-9577-c5f99e51aadf service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:32:16.650637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29e4f-045e-43a2-9577-c5f99e51aadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:32:16.652511 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b7e29e4f-045e-43a2-9577-c5f99e51aadf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:32:16.662366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e29e4f-045e-43a2-9577-c5f99e51aadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:32:16.663853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e29e4f-045e-43a2-9577-c5f99e51aadf service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:32:16.673994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1256/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:32:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:32:26.298782 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:32:26.668554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=12 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:33:38.357431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89d750-0756-446f-ac0b-e6240f08a720 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:33:38.359249 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2e89d750-0756-446f-ac0b-e6240f08a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:33:38.442344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89d750-0756-446f-ac0b-e6240f08a720 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:33:38.446661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:33:38.447325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:33:38.447619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:33:38.447897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:33:38.449891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:33:38.460214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:33:38.462152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:33:38.470873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1243/2499] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:33:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:33:48.466838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=35 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:13.638528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e29e4f-045e-43a2-9577-c5f99e51aadf service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:34:13.713818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e29e4f-045e-43a2-9577-c5f99e51aadf service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:34:13.718116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0360b9f-1118-457d-b4a7-b63020741cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:34:13.718789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0360b9f-1118-457d-b4a7-b63020741cdf service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:34:13.719083 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0360b9f-1118-457d-b4a7-b63020741cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:34:13.719358 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0360b9f-1118-457d-b4a7-b63020741cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:34:13.721515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f0360b9f-1118-457d-b4a7-b63020741cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:34:13.804035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0360b9f-1118-457d-b4a7-b63020741cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:34:13.805516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0360b9f-1118-457d-b4a7-b63020741cdf service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:34:13.815763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1257/2500] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:34:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:34:16.004508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:34:16.006218 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:34:16.033529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd4f68-2bc2-4116-ad31-340b930727f3 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:34:16.039758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34f34e-7789-4230-8c59-ea0b67c516c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:34:16.040762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f34e-7789-4230-8c59-ea0b67c516c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:34:16.041046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f34e-7789-4230-8c59-ea0b67c516c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:34:16.041322 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34f34e-7789-4230-8c59-ea0b67c516c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:34:16.043509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0b34f34e-7789-4230-8c59-ea0b67c516c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:34:16.117598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34f34e-7789-4230-8c59-ea0b67c516c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:34:16.119314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34f34e-7789-4230-8c59-ea0b67c516c2 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:34:16.128696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1244/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:34:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:34:18.977798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa864d-c0e5-4c61-b45f-27c5fdec33d3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:34:18.978486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa864d-c0e5-4c61-b45f-27c5fdec33d3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:34:18.978870 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa864d-c0e5-4c61-b45f-27c5fdec33d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:34:19.028712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-97fa864d-c0e5-4c61-b45f-27c5fdec33d3 None None] MFA Rules not processed for user `c6bc5146c28948c5859cd9eb3d09e0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:34:19.029933 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-97fa864d-c0e5-4c61-b45f-27c5fdec33d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:34:19.100633 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1258/2502] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:34:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:34:26.124495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=38 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:29.095098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:40.143031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c667c5-de0d-4bf8-aa15-527e135dd09f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:34:40.143544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c667c5-de0d-4bf8-aa15-527e135dd09f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:34:40.143670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c667c5-de0d-4bf8-aa15-527e135dd09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:34:40.162894 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b4c667c5-de0d-4bf8-aa15-527e135dd09f None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:34:40.164722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b4c667c5-de0d-4bf8-aa15-527e135dd09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:34:40.181879 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1245/2503] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 13:34:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:34:40.232949 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa864d-c0e5-4c61-b45f-27c5fdec33d3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:34:40.245084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa864d-c0e5-4c61-b45f-27c5fdec33d3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:34:40.250170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949aa291-e26f-4287-a318-6533ed5f25ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:34:40.250850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aa291-e26f-4287-a318-6533ed5f25ea service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:34:40.251135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aa291-e26f-4287-a318-6533ed5f25ea service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:34:40.251406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aa291-e26f-4287-a318-6533ed5f25ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:34:40.259616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949aa291-e26f-4287-a318-6533ed5f25ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:34:40.261259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949aa291-e26f-4287-a318-6533ed5f25ea service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:34:40.270177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1259/2504] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:34:50.174695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:34:50.266368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:02.199524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c667c5-de0d-4bf8-aa15-527e135dd09f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:02.212126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c667c5-de0d-4bf8-aa15-527e135dd09f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:02.217633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d045-1e43-4946-8577-66ee06cc936c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984780a6a8df405dbbb2ba4c46dd841c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:02.218341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d045-1e43-4946-8577-66ee06cc936c service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:02.218851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d045-1e43-4946-8577-66ee06cc936c service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:02.219136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d045-1e43-4946-8577-66ee06cc936c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:02.221203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7df7d045-1e43-4946-8577-66ee06cc936c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:02.319022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7d045-1e43-4946-8577-66ee06cc936c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:02.320695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7d045-1e43-4946-8577-66ee06cc936c service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:02.344038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1246/2505] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:02.414701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949aa291-e26f-4287-a318-6533ed5f25ea service swift] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:02.416247 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-949aa291-e26f-4287-a318-6533ed5f25ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:02.428892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949aa291-e26f-4287-a318-6533ed5f25ea service swift] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:02.433709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321a03d-5678-46fc-ad7c-75ed278aeaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:02.434432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321a03d-5678-46fc-ad7c-75ed278aeaff service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:02.434721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321a03d-5678-46fc-ad7c-75ed278aeaff service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:02.434997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321a03d-5678-46fc-ad7c-75ed278aeaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:02.437052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c321a03d-5678-46fc-ad7c-75ed278aeaff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:02.447179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321a03d-5678-46fc-ad7c-75ed278aeaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:02.448650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321a03d-5678-46fc-ad7c-75ed278aeaff service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:02.456776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1260/2506] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:02.547634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d045-1e43-4946-8577-66ee06cc936c service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:02.558318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d045-1e43-4946-8577-66ee06cc936c service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:02.562533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90acab-8d75-4262-8ffd-38cb8882c369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:02.563227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90acab-8d75-4262-8ffd-38cb8882c369 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:02.563515 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90acab-8d75-4262-8ffd-38cb8882c369 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:02.564099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90acab-8d75-4262-8ffd-38cb8882c369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:02.565925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cc90acab-8d75-4262-8ffd-38cb8882c369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:02.580112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90acab-8d75-4262-8ffd-38cb8882c369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:02.581799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90acab-8d75-4262-8ffd-38cb8882c369 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:02.593744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1247/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:05.777105 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf677b-982e-4ce4-8a05-15ae278c0e6f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:05.777592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf677b-982e-4ce4-8a05-15ae278c0e6f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:05.777836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf677b-982e-4ce4-8a05-15ae278c0e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:05.797777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c6cf677b-982e-4ce4-8a05-15ae278c0e6f None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:05.799036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c6cf677b-982e-4ce4-8a05-15ae278c0e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:05.806878 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1261/2508] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 13:35:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:05.818821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90acab-8d75-4262-8ffd-38cb8882c369 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:05.830846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90acab-8d75-4262-8ffd-38cb8882c369 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:05.836158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc6f0-596c-4296-912c-6e9535fe61e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:05.837191 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc6f0-596c-4296-912c-6e9535fe61e8 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:05.837715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc6f0-596c-4296-912c-6e9535fe61e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:05.838278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc6f0-596c-4296-912c-6e9535fe61e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:05.850761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbc6f0-596c-4296-912c-6e9535fe61e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:05.852681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbc6f0-596c-4296-912c-6e9535fe61e8 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:05.861886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1248/2509] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:35:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:35:12.059081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf677b-982e-4ce4-8a05-15ae278c0e6f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:12.077753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf677b-982e-4ce4-8a05-15ae278c0e6f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:12.084526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810cef0-f79e-4d9b-ba65-86fdfc6bf596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:12.085276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cef0-f79e-4d9b-ba65-86fdfc6bf596 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:12.085602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cef0-f79e-4d9b-ba65-86fdfc6bf596 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:12.085910 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cef0-f79e-4d9b-ba65-86fdfc6bf596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:12.095752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810cef0-f79e-4d9b-ba65-86fdfc6bf596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:12.097601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810cef0-f79e-4d9b-ba65-86fdfc6bf596 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:12.108690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1262/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:14.208338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc6f0-596c-4296-912c-6e9535fe61e8 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:14.218579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc6f0-596c-4296-912c-6e9535fe61e8 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:14.223757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178638-e563-41cb-902e-6f7e8c5cdbe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:14.224705 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178638-e563-41cb-902e-6f7e8c5cdbe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:14.225097 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178638-e563-41cb-902e-6f7e8c5cdbe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:14.225483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178638-e563-41cb-902e-6f7e8c5cdbe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:14.240382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6178638-e563-41cb-902e-6f7e8c5cdbe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:14.241778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6178638-e563-41cb-902e-6f7e8c5cdbe4 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:14.253262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1249/2511] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:15.524998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810cef0-f79e-4d9b-ba65-86fdfc6bf596 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:15.536428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810cef0-f79e-4d9b-ba65-86fdfc6bf596 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:15.540650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c5696-48f8-4987-8703-ae2469060191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:15.541315 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c5696-48f8-4987-8703-ae2469060191 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:15.541603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c5696-48f8-4987-8703-ae2469060191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:15.541881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c5696-48f8-4987-8703-ae2469060191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:15.553273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c5696-48f8-4987-8703-ae2469060191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:15.555158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c5696-48f8-4987-8703-ae2469060191 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:15.567379 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1263/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:16.646025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178638-e563-41cb-902e-6f7e8c5cdbe4 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:16.657734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178638-e563-41cb-902e-6f7e8c5cdbe4 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:16.661440 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4888b-e199-4d8d-896c-de22381daf2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:16.662131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4888b-e199-4d8d-896c-de22381daf2e service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:16.662427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4888b-e199-4d8d-896c-de22381daf2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:16.662708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4888b-e199-4d8d-896c-de22381daf2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:16.665765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-06f4888b-e199-4d8d-896c-de22381daf2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:16.679387 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4888b-e199-4d8d-896c-de22381daf2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:16.681687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4888b-e199-4d8d-896c-de22381daf2e service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:16.694125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1250/2513] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:25.562425 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=21 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:26.688358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=67 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:27.097346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c5696-48f8-4987-8703-ae2469060191 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:27.099922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fc1c5696-48f8-4987-8703-ae2469060191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:27.117545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c5696-48f8-4987-8703-ae2469060191 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:27.123621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23326bf-9876-4c33-bb99-a6dc8fc1a37d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:27.124478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23326bf-9876-4c33-bb99-a6dc8fc1a37d service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:27.124901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23326bf-9876-4c33-bb99-a6dc8fc1a37d service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:27.125310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23326bf-9876-4c33-bb99-a6dc8fc1a37d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:27.138155 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23326bf-9876-4c33-bb99-a6dc8fc1a37d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:27.140021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23326bf-9876-4c33-bb99-a6dc8fc1a37d service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:27.155136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1264/2514] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:29.671112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d259f9-12fa-4523-8cff-e953f2f02313 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:29.671112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d259f9-12fa-4523-8cff-e953f2f02313 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:29.671537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d259f9-12fa-4523-8cff-e953f2f02313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:29.691896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e2d259f9-12fa-4523-8cff-e953f2f02313 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:29.693109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e2d259f9-12fa-4523-8cff-e953f2f02313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:29.706304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1251/2515] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 13:35:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:29.729205 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23326bf-9876-4c33-bb99-a6dc8fc1a37d service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:29.745951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23326bf-9876-4c33-bb99-a6dc8fc1a37d service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:29.752534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b825f8e-babf-4991-9bed-dc37cad4a81c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:29.753208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b825f8e-babf-4991-9bed-dc37cad4a81c service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:29.753502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b825f8e-babf-4991-9bed-dc37cad4a81c service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:29.753780 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b825f8e-babf-4991-9bed-dc37cad4a81c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:29.768297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b825f8e-babf-4991-9bed-dc37cad4a81c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:29.771108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b825f8e-babf-4991-9bed-dc37cad4a81c service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:29.781873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1265/2516] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:35:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:35:31.001922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d259f9-12fa-4523-8cff-e953f2f02313 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:31.011513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d259f9-12fa-4523-8cff-e953f2f02313 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:31.015252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:31.015915 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:31.016194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:31.016468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:31.018269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:31.052375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:31.053844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:31.073574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1252/2517] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:34.551692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b825f8e-babf-4991-9bed-dc37cad4a81c service swift] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:34.555725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9b825f8e-babf-4991-9bed-dc37cad4a81c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:34.574896 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b825f8e-babf-4991-9bed-dc37cad4a81c service swift] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:34.580370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f200ba-4339-436c-ba5b-8830fcc6892b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:34.581070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f200ba-4339-436c-ba5b-8830fcc6892b service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:34.581357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f200ba-4339-436c-ba5b-8830fcc6892b service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:34.581613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f200ba-4339-436c-ba5b-8830fcc6892b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:34.583600 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c2f200ba-4339-436c-ba5b-8830fcc6892b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:34.596924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f200ba-4339-436c-ba5b-8830fcc6892b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:34.598696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f200ba-4339-436c-ba5b-8830fcc6892b service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:34.610592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1266/2518] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:34.611116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:34.612669 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:34.626134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590126aa-247d-45c1-97fe-b148c31954ff service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:34.631180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:34.632327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:34.632634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:34.633155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] PATH_INFO: `/v3/users/8bfbd9324f8040c496a83eb599ca80c0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:34.648399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfbd9324f8040c496a83eb599ca80c0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:34.650424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:34.706696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfbd9324f8040c496a83eb599ca80c0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:34.720079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfbd9324f8040c496a83eb599ca80c0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:34.720870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfbd9324f8040c496a83eb599ca80c0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:34.728611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfbd9324f8040c496a83eb599ca80c0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:34.736627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ce71cb-960e-4e2c-acc0-9c5162d5739a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfbd9324f8040c496a83eb599ca80c0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:34.742913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1253/2519] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:35:34 2022] DELETE /identity/v3/users/8bfbd9324f8040c496a83eb599ca80c0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:35:34.927257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f200ba-4339-436c-ba5b-8830fcc6892b service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:34.941870 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f200ba-4339-436c-ba5b-8830fcc6892b service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:35.020884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:35.021785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.022071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.022457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] PATH_INFO: `/v3/projects/13a3f9864ad04941bc902febad84876d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.024316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a3f9864ad04941bc902febad84876d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:35.026467 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:35.077612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a3f9864ad04941bc902febad84876d', 'request_id': 'req-4515c6b7-2bce-437d-acf9-268511953d92'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:35.086950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a3f9864ad04941bc902febad84876d', 'request_id': 'req-4515c6b7-2bce-437d-acf9-268511953d92'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:35.096410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a3f9864ad04941bc902febad84876d', 'request_id': 'req-4515c6b7-2bce-437d-acf9-268511953d92'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:35.108095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] The token cache is being invalidate because project 13a3f9864ad04941bc902febad84876d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:35:35.108382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:35.109084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4515c6b7-2bce-437d-acf9-268511953d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:35.110695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1267/2520] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:35:34 2022] DELETE /identity/v3/projects/13a3f9864ad04941bc902febad84876d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:35.115729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a557e-9dc7-46e5-8c3b-b913d7d57972 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.116024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a557e-9dc7-46e5-8c3b-b913d7d57972 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.116304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a557e-9dc7-46e5-8c3b-b913d7d57972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.176837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bf4a557e-9dc7-46e5-8c3b-b913d7d57972 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:35.178083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf4a557e-9dc7-46e5-8c3b-b913d7d57972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:35.217932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:35.245495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1254/2521] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:35.253500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750c6bc-5ee9-4120-8082-f028c92f4dc1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.253789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750c6bc-5ee9-4120-8082-f028c92f4dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.254068 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750c6bc-5ee9-4120-8082-f028c92f4dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.275826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9750c6bc-5ee9-4120-8082-f028c92f4dc1 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:35.277062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9750c6bc-5ee9-4120-8082-f028c92f4dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:35.286907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1268/2522] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:35.291804 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a557e-9dc7-46e5-8c3b-b913d7d57972 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:35.301829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a557e-9dc7-46e5-8c3b-b913d7d57972 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:35.307972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1637e7-e7fd-440c-9eee-da0bc166d709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:35.308651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1637e7-e7fd-440c-9eee-da0bc166d709 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.308920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1637e7-e7fd-440c-9eee-da0bc166d709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.309202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1637e7-e7fd-440c-9eee-da0bc166d709 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.309947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1637e7-e7fd-440c-9eee-da0bc166d709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:35:35.310298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1637e7-e7fd-440c-9eee-da0bc166d709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:35.312635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1637e7-e7fd-440c-9eee-da0bc166d709 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:35.325816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1255/2523] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:35:35.330428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750c6bc-5ee9-4120-8082-f028c92f4dc1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:35.340104 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750c6bc-5ee9-4120-8082-f028c92f4dc1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:35.345907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93bcda-626f-4d62-a75c-c10b3d88b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:35.346606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93bcda-626f-4d62-a75c-c10b3d88b666 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.346883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93bcda-626f-4d62-a75c-c10b3d88b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.347151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93bcda-626f-4d62-a75c-c10b3d88b666 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.347891 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93bcda-626f-4d62-a75c-c10b3d88b666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:35.349876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93bcda-626f-4d62-a75c-c10b3d88b666 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:35.390599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1269/2524] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:35:35 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:35.396411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1637e7-e7fd-440c-9eee-da0bc166d709 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:35.406930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1637e7-e7fd-440c-9eee-da0bc166d709 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:35.464035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947078d9-1bad-43d9-8a41-b25e1e4d6444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:35.464713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947078d9-1bad-43d9-8a41-b25e1e4d6444 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.464996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947078d9-1bad-43d9-8a41-b25e1e4d6444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.465276 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947078d9-1bad-43d9-8a41-b25e1e4d6444 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.465968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947078d9-1bad-43d9-8a41-b25e1e4d6444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:35.467962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947078d9-1bad-43d9-8a41-b25e1e4d6444 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:35.494239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1256/2525] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:35:35 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:35.496650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93bcda-626f-4d62-a75c-c10b3d88b666 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:35.508223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93bcda-626f-4d62-a75c-c10b3d88b666 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:35.513952 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb50db4-28ff-4543-99dc-ca7c9b00fd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:35.514696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb50db4-28ff-4543-99dc-ca7c9b00fd4a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.514975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb50db4-28ff-4543-99dc-ca7c9b00fd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.515251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb50db4-28ff-4543-99dc-ca7c9b00fd4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.515970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb50db4-28ff-4543-99dc-ca7c9b00fd4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:35.517621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb50db4-28ff-4543-99dc-ca7c9b00fd4a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:35.527905 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1270/2526] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:35:35.532001 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947078d9-1bad-43d9-8a41-b25e1e4d6444 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:35.542173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947078d9-1bad-43d9-8a41-b25e1e4d6444 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:35.547120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53620d1c-943e-48e6-ac9b-bd71050a1bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:35.547786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620d1c-943e-48e6-ac9b-bd71050a1bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.548071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620d1c-943e-48e6-ac9b-bd71050a1bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.548344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620d1c-943e-48e6-ac9b-bd71050a1bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.549068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53620d1c-943e-48e6-ac9b-bd71050a1bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:35.550735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53620d1c-943e-48e6-ac9b-bd71050a1bf0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:35.560763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1257/2527] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 13:35:35.564885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb50db4-28ff-4543-99dc-ca7c9b00fd4a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:35.570408 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:35.576196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb50db4-28ff-4543-99dc-ca7c9b00fd4a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:35.582730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4494d03-27a6-423f-9897-90811b8be10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:35.583592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4494d03-27a6-423f-9897-90811b8be10c admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.584004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4494d03-27a6-423f-9897-90811b8be10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.584344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4494d03-27a6-423f-9897-90811b8be10c admin admin] PATH_INFO: `/v3/projects/914f522801294f9298927cec1f3c4ccc/users/0443ce09d57541c78ab475377e4fe1fb/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.600262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4494d03-27a6-423f-9897-90811b8be10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=914f522801294f9298927cec1f3c4ccc, user_id=0443ce09d57541c78ab475377e4fe1fb, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:35.603172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4494d03-27a6-423f-9897-90811b8be10c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:35.619176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1271/2528] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:35:35 2022] PUT /identity/v3/projects/914f522801294f9298927cec1f3c4ccc/users/0443ce09d57541c78ab475377e4fe1fb/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:35.630511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdd720-68f4-4044-ac6f-36d2f42888b9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.631047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdd720-68f4-4044-ac6f-36d2f42888b9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.631136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdd720-68f4-4044-ac6f-36d2f42888b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.658754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-97cdd720-68f4-4044-ac6f-36d2f42888b9 None None] MFA Rules not processed for user `0443ce09d57541c78ab475377e4fe1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:35.659971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-97cdd720-68f4-4044-ac6f-36d2f42888b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:35.730397 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1258/2529] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:35.743337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4494d03-27a6-423f-9897-90811b8be10c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:35.745228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d4494d03-27a6-423f-9897-90811b8be10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:35.822340 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4494d03-27a6-423f-9897-90811b8be10c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:35.828487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da3f0c-6b87-4c18-88e7-131d0e1d4d47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:35.829140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3f0c-6b87-4c18-88e7-131d0e1d4d47 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:35.829426 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3f0c-6b87-4c18-88e7-131d0e1d4d47 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:35.829704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3f0c-6b87-4c18-88e7-131d0e1d4d47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:35.837862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da3f0c-6b87-4c18-88e7-131d0e1d4d47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:35.839451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da3f0c-6b87-4c18-88e7-131d0e1d4d47 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:35.848490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1272/2530] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:39.629703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdd720-68f4-4044-ac6f-36d2f42888b9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:39.674563 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:39.700710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdd720-68f4-4044-ac6f-36d2f42888b9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:39.705189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:39.706104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:39.706390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:39.706665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] PATH_INFO: `/v3/users/0443ce09d57541c78ab475377e4fe1fb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:39.707858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0443ce09d57541c78ab475377e4fe1fb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:39.709799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:39.760350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0443ce09d57541c78ab475377e4fe1fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:39.771921 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0443ce09d57541c78ab475377e4fe1fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:39.772578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0443ce09d57541c78ab475377e4fe1fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:39.781962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0443ce09d57541c78ab475377e4fe1fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:39.790362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0443ce09d57541c78ab475377e4fe1fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:39.797151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1259/2531] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:35:39 2022] DELETE /identity/v3/users/0443ce09d57541c78ab475377e4fe1fb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:39.801786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592a9c-bec8-4877-a32f-fe4a433e26d3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:39.802274 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592a9c-bec8-4877-a32f-fe4a433e26d3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:39.802356 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592a9c-bec8-4877-a32f-fe4a433e26d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:39.820226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-99592a9c-bec8-4877-a32f-fe4a433e26d3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:39.821429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-99592a9c-bec8-4877-a32f-fe4a433e26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:39.888978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1273/2532] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:39.899007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:39.900649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:39.961492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5267-efff-48c6-acbc-0dcd3582eefd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:39.965995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3a4f2-95aa-40da-85f8-d97f555269df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:39.966962 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3a4f2-95aa-40da-85f8-d97f555269df service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:39.967297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3a4f2-95aa-40da-85f8-d97f555269df service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:39.967610 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3a4f2-95aa-40da-85f8-d97f555269df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:39.981714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3a4f2-95aa-40da-85f8-d97f555269df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:39.983215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3a4f2-95aa-40da-85f8-d97f555269df service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:39.993561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1260/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:40.296081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592a9c-bec8-4877-a32f-fe4a433e26d3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:40.298278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-99592a9c-bec8-4877-a32f-fe4a433e26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:40.316205 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592a9c-bec8-4877-a32f-fe4a433e26d3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:40.323229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:40.324133 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.324406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.324670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] PATH_INFO: `/v3/projects/914f522801294f9298927cec1f3c4ccc` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.325944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914f522801294f9298927cec1f3c4ccc)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:40.327997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:40.378529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914f522801294f9298927cec1f3c4ccc', 'request_id': 'req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:40.385769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914f522801294f9298927cec1f3c4ccc', 'request_id': 'req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:40.389666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:40.399109 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914f522801294f9298927cec1f3c4ccc', 'request_id': 'req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:40.410471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] The token cache is being invalidate because project 914f522801294f9298927cec1f3c4ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:35:40.410761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:40.411485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-66b27065-4d26-4b8a-96d8-b9596ea5b2a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:40.413528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1274/2534] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:35:40 2022] DELETE /identity/v3/projects/914f522801294f9298927cec1f3c4ccc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:40.418669 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097834f-91c8-4692-af00-8c9f0b34721c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.419162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097834f-91c8-4692-af00-8c9f0b34721c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.419545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097834f-91c8-4692-af00-8c9f0b34721c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.438876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d097834f-91c8-4692-af00-8c9f0b34721c None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:40.440123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d097834f-91c8-4692-af00-8c9f0b34721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:40.495304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:40.506560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1261/2535] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:40.514457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d718-e9af-4c1f-9621-23ae20186041 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.514750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d718-e9af-4c1f-9621-23ae20186041 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.515031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d718-e9af-4c1f-9621-23ae20186041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.533972 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e788d718-e9af-4c1f-9621-23ae20186041 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:40.535329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e788d718-e9af-4c1f-9621-23ae20186041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:40.548459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1275/2536] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:35:40.551291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097834f-91c8-4692-af00-8c9f0b34721c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:40.562941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097834f-91c8-4692-af00-8c9f0b34721c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:40.568185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d718-e9af-4c1f-9621-23ae20186041 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:40.568336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac304-1d61-4358-8e8e-6be20e5aef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:40.568903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac304-1d61-4358-8e8e-6be20e5aef3d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.569189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac304-1d61-4358-8e8e-6be20e5aef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.569479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac304-1d61-4358-8e8e-6be20e5aef3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.569885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e788d718-e9af-4c1f-9621-23ae20186041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:40.570431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdac304-1d61-4358-8e8e-6be20e5aef3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:35:40.570743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdac304-1d61-4358-8e8e-6be20e5aef3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:40.572488 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdac304-1d61-4358-8e8e-6be20e5aef3d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:40.588752 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1262/2537] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:35:40.589871 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac304-1d61-4358-8e8e-6be20e5aef3d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:40.603585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac304-1d61-4358-8e8e-6be20e5aef3d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:40.609514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a974fc-8539-48ea-85e6-33992954e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:40.610260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a974fc-8539-48ea-85e6-33992954e9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.610546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a974fc-8539-48ea-85e6-33992954e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.610826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a974fc-8539-48ea-85e6-33992954e9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.611525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a974fc-8539-48ea-85e6-33992954e9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:40.613500 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a974fc-8539-48ea-85e6-33992954e9c0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:40.652219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1263/2538] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:35:40 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:40.656890 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a974fc-8539-48ea-85e6-33992954e9c0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:40.664427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d718-e9af-4c1f-9621-23ae20186041 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:40.735034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a974fc-8539-48ea-85e6-33992954e9c0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:40.737526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee2bcc-5eae-4d95-b01b-0f2c872fbd4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:40.738252 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee2bcc-5eae-4d95-b01b-0f2c872fbd4d service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.738496 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee2bcc-5eae-4d95-b01b-0f2c872fbd4d service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.738770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee2bcc-5eae-4d95-b01b-0f2c872fbd4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.740096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc539e5d-9bee-4b3b-8fd2-69023d1f0f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:40.740779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-69ee2bcc-5eae-4d95-b01b-0f2c872fbd4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:40.740897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc539e5d-9bee-4b3b-8fd2-69023d1f0f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.741197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc539e5d-9bee-4b3b-8fd2-69023d1f0f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.741479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc539e5d-9bee-4b3b-8fd2-69023d1f0f3b admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.742892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc539e5d-9bee-4b3b-8fd2-69023d1f0f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:40.744920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc539e5d-9bee-4b3b-8fd2-69023d1f0f3b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:40.754379 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee2bcc-5eae-4d95-b01b-0f2c872fbd4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:40.755948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee2bcc-5eae-4d95-b01b-0f2c872fbd4d service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:40.767293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1276/2539] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:35:40.771504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1264/2540] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:35:40 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:40.776180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee2bcc-5eae-4d95-b01b-0f2c872fbd4d service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:40.787038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee2bcc-5eae-4d95-b01b-0f2c872fbd4d service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:40.792479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4e584-d23c-4528-abf2-287ca16cca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:40.793157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4e584-d23c-4528-abf2-287ca16cca24 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.793444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4e584-d23c-4528-abf2-287ca16cca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.793722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4e584-d23c-4528-abf2-287ca16cca24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.794533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4e584-d23c-4528-abf2-287ca16cca24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:40.796178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4e584-d23c-4528-abf2-287ca16cca24 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:40.807134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1277/2541] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:35:40.811284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc539e5d-9bee-4b3b-8fd2-69023d1f0f3b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:40.822169 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc539e5d-9bee-4b3b-8fd2-69023d1f0f3b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:40.826978 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c06db-2dd5-4c6b-b276-a4b40684f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:40.827647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c06db-2dd5-4c6b-b276-a4b40684f5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.827944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c06db-2dd5-4c6b-b276-a4b40684f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.828217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c06db-2dd5-4c6b-b276-a4b40684f5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.828951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c06db-2dd5-4c6b-b276-a4b40684f5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:40.830617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c06db-2dd5-4c6b-b276-a4b40684f5e4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:40.841253 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1265/2542] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:35:40.845428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4e584-d23c-4528-abf2-287ca16cca24 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:40.856919 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4e584-d23c-4528-abf2-287ca16cca24 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:40.861867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf238b-64d9-487b-a2eb-6e25af747f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:40.862791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf238b-64d9-487b-a2eb-6e25af747f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.863078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf238b-64d9-487b-a2eb-6e25af747f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.863357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf238b-64d9-487b-a2eb-6e25af747f7f admin admin] PATH_INFO: `/v3/projects/21559fce77b648c2b25f1f4c8ec2b290/users/400740a996cc4b918ccf9151c9f30600/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.879220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf238b-64d9-487b-a2eb-6e25af747f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21559fce77b648c2b25f1f4c8ec2b290, user_id=400740a996cc4b918ccf9151c9f30600, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:40.881968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf238b-64d9-487b-a2eb-6e25af747f7f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:40.897464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1278/2543] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:35:40 2022] PUT /identity/v3/projects/21559fce77b648c2b25f1f4c8ec2b290/users/400740a996cc4b918ccf9151c9f30600/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:40.908603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66dcb-b788-4381-aba7-29e8104ade29 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:40.908841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66dcb-b788-4381-aba7-29e8104ade29 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:40.909127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66dcb-b788-4381-aba7-29e8104ade29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:40.939990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-efa66dcb-b788-4381-aba7-29e8104ade29 None None] MFA Rules not processed for user `400740a996cc4b918ccf9151c9f30600`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:40.941200 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-efa66dcb-b788-4381-aba7-29e8104ade29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:41.019873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1266/2544] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:41.025635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf238b-64d9-487b-a2eb-6e25af747f7f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:41.067751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:41.091771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf238b-64d9-487b-a2eb-6e25af747f7f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:41.097055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a749c3-7b30-4c94-a1a5-afafd7706545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:41.097726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a749c3-7b30-4c94-a1a5-afafd7706545 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:41.098012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a749c3-7b30-4c94-a1a5-afafd7706545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:41.098343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a749c3-7b30-4c94-a1a5-afafd7706545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:41.099047 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a749c3-7b30-4c94-a1a5-afafd7706545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:41.101018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a749c3-7b30-4c94-a1a5-afafd7706545 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:41.132231 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1279/2545] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:35:41 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:41.138276 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66dcb-b788-4381-aba7-29e8104ade29 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:41.152818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66dcb-b788-4381-aba7-29e8104ade29 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:41.184256 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:41.221451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebde31-f9fa-41bd-b75b-607299e2e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:41.222171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebde31-f9fa-41bd-b75b-607299e2e907 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:41.222453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebde31-f9fa-41bd-b75b-607299e2e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:41.222735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebde31-f9fa-41bd-b75b-607299e2e907 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:41.223453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebde31-f9fa-41bd-b75b-607299e2e907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:41.225407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebde31-f9fa-41bd-b75b-607299e2e907 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:41.247833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1267/2546] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:35:41 2022] POST /identity/v3/users => generated 307 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:41.251877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a749c3-7b30-4c94-a1a5-afafd7706545 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:41.262468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a749c3-7b30-4c94-a1a5-afafd7706545 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:41.267599 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3437c-4328-4c12-8ace-67a5a46b4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:41.268301 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3437c-4328-4c12-8ace-67a5a46b4eba admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:41.268587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3437c-4328-4c12-8ace-67a5a46b4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:41.268869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3437c-4328-4c12-8ace-67a5a46b4eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:41.269645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3437c-4328-4c12-8ace-67a5a46b4eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:41.271314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3437c-4328-4c12-8ace-67a5a46b4eba admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:41.282534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1280/2547] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:35:41.286781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebde31-f9fa-41bd-b75b-607299e2e907 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:41.297457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebde31-f9fa-41bd-b75b-607299e2e907 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:41.302341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be6126-794e-4572-b26a-f01f22b74fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:41.303235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be6126-794e-4572-b26a-f01f22b74fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:41.303521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be6126-794e-4572-b26a-f01f22b74fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:41.303800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be6126-794e-4572-b26a-f01f22b74fc0 admin admin] PATH_INFO: `/v3/projects/0ea074840325482c9aab0e12e50024c5/users/fa2716989dee4d6cba7cb14318e5d669/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:41.322739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be6126-794e-4572-b26a-f01f22b74fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea074840325482c9aab0e12e50024c5, user_id=fa2716989dee4d6cba7cb14318e5d669, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:41.325430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be6126-794e-4572-b26a-f01f22b74fc0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:41.341471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1268/2548] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:35:41 2022] PUT /identity/v3/projects/0ea074840325482c9aab0e12e50024c5/users/fa2716989dee4d6cba7cb14318e5d669/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:41.345453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3437c-4328-4c12-8ace-67a5a46b4eba admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:41.356034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3437c-4328-4c12-8ace-67a5a46b4eba admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:41.416795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27227d26-bd3b-426b-9953-99efd5be2238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:41.417466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27227d26-bd3b-426b-9953-99efd5be2238 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:41.417753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27227d26-bd3b-426b-9953-99efd5be2238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:41.418030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27227d26-bd3b-426b-9953-99efd5be2238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:41.418806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27227d26-bd3b-426b-9953-99efd5be2238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:41.420471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27227d26-bd3b-426b-9953-99efd5be2238 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:41.431290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1281/2549] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:35:41.435737 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be6126-794e-4572-b26a-f01f22b74fc0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:41.447393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be6126-794e-4572-b26a-f01f22b74fc0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:41.452274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c3d1d-668d-4be9-9d48-2ff050dea5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:41.453179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c3d1d-668d-4be9-9d48-2ff050dea5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:41.453460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c3d1d-668d-4be9-9d48-2ff050dea5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:41.453739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c3d1d-668d-4be9-9d48-2ff050dea5ce admin admin] PATH_INFO: `/v3/projects/0ea074840325482c9aab0e12e50024c5/users/fa2716989dee4d6cba7cb14318e5d669/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:41.455794 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c3d1d-668d-4be9-9d48-2ff050dea5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea074840325482c9aab0e12e50024c5, user_id=fa2716989dee4d6cba7cb14318e5d669, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:41.458519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c3d1d-668d-4be9-9d48-2ff050dea5ce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:41.469056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1269/2550] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:35:41 2022] PUT /identity/v3/projects/0ea074840325482c9aab0e12e50024c5/users/fa2716989dee4d6cba7cb14318e5d669/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:41.481291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8ef97-dc35-4c90-abdc-9967765e2be7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:41.481574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8ef97-dc35-4c90-abdc-9967765e2be7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:41.481861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8ef97-dc35-4c90-abdc-9967765e2be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:41.509851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-26b8ef97-dc35-4c90-abdc-9967765e2be7 None None] MFA Rules not processed for user `fa2716989dee4d6cba7cb14318e5d669`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:41.511093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-26b8ef97-dc35-4c90-abdc-9967765e2be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:41.582000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1282/2551] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:41.593021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c3d1d-668d-4be9-9d48-2ff050dea5ce admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:41.595086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5d7c3d1d-668d-4be9-9d48-2ff050dea5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:41.655694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c3d1d-668d-4be9-9d48-2ff050dea5ce admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:41.659941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498553d-d211-4579-9275-d3c72fc9ec7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:41.660582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498553d-d211-4579-9275-d3c72fc9ec7b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:41.660868 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498553d-d211-4579-9275-d3c72fc9ec7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:41.661157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498553d-d211-4579-9275-d3c72fc9ec7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:41.672701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498553d-d211-4579-9275-d3c72fc9ec7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:41.674881 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498553d-d211-4579-9275-d3c72fc9ec7b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:41.691429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1270/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:41.837513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8ef97-dc35-4c90-abdc-9967765e2be7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:41.874806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:41.909386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8ef97-dc35-4c90-abdc-9967765e2be7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:41.917523 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:41.918708 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:41.919601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:41.919601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] PATH_INFO: `/v3/users/400740a996cc4b918ccf9151c9f30600` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:41.921470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] RBAC: Authorizing `identity:delete_user(user_id=400740a996cc4b918ccf9151c9f30600)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:41.924444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:41.981529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400740a996cc4b918ccf9151c9f30600'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:41.982163 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400740a996cc4b918ccf9151c9f30600'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:41.982764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400740a996cc4b918ccf9151c9f30600'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:41.989645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400740a996cc4b918ccf9151c9f30600'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:41.997381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400740a996cc4b918ccf9151c9f30600'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.018721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1283/2553] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:35:41 2022] DELETE /identity/v3/users/400740a996cc4b918ccf9151c9f30600 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:42.023512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64fb00-85fb-46db-871f-2bd437e6cb0d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:42.024209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64fb00-85fb-46db-871f-2bd437e6cb0d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:42.024499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64fb00-85fb-46db-871f-2bd437e6cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:42.042396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8c64fb00-85fb-46db-871f-2bd437e6cb0d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:42.043612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8c64fb00-85fb-46db-871f-2bd437e6cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:42.105395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1271/2554] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:42.117203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:42.118758 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:42.178294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd70bf-ea7f-46b7-a5da-edfda4c2937e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:42.182692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e338b-adad-41b9-92ef-b66d994dbf14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:42.183352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e338b-adad-41b9-92ef-b66d994dbf14 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:42.183635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e338b-adad-41b9-92ef-b66d994dbf14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:42.183910 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e338b-adad-41b9-92ef-b66d994dbf14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:42.193939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e338b-adad-41b9-92ef-b66d994dbf14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:42.195604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e338b-adad-41b9-92ef-b66d994dbf14 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:42.205737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1284/2555] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:42.614232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64fb00-85fb-46db-871f-2bd437e6cb0d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:42.615757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8c64fb00-85fb-46db-871f-2bd437e6cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:42.628501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64fb00-85fb-46db-871f-2bd437e6cb0d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:42.635162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:42.636217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:42.637316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:42.637675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] PATH_INFO: `/v3/projects/21559fce77b648c2b25f1f4c8ec2b290` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:42.639896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21559fce77b648c2b25f1f4c8ec2b290)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:42.642082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:42.668743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:42.692752 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21559fce77b648c2b25f1f4c8ec2b290', 'request_id': 'req-eab67a67-30ba-4612-b9dc-3021567ceec9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.698606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21559fce77b648c2b25f1f4c8ec2b290', 'request_id': 'req-eab67a67-30ba-4612-b9dc-3021567ceec9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.704781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21559fce77b648c2b25f1f4c8ec2b290', 'request_id': 'req-eab67a67-30ba-4612-b9dc-3021567ceec9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.720012 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] The token cache is being invalidate because project 21559fce77b648c2b25f1f4c8ec2b290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:35:42.720294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.720923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.722527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1272/2556] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:35:42 2022] DELETE /identity/v3/projects/21559fce77b648c2b25f1f4c8ec2b290 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:42.727130 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e338b-adad-41b9-92ef-b66d994dbf14 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:42.741734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e338b-adad-41b9-92ef-b66d994dbf14 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:42.790427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:42.798052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:42.798972 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:42.799264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:42.799552 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] PATH_INFO: `/v3/users/fa2716989dee4d6cba7cb14318e5d669` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:42.800808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2716989dee4d6cba7cb14318e5d669)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:42.803606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:42.860039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2716989dee4d6cba7cb14318e5d669'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.860837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2716989dee4d6cba7cb14318e5d669'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.861819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2716989dee4d6cba7cb14318e5d669'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.871515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2716989dee4d6cba7cb14318e5d669'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.880997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-28ad7e03-c2db-4ab5-8a47-a857db3a31cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2716989dee4d6cba7cb14318e5d669'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:42.899370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1285/2557] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:35:42 2022] DELETE /identity/v3/users/fa2716989dee4d6cba7cb14318e5d669 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:43.181786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:43.183309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:43.196334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67a67-30ba-4612-b9dc-3021567ceec9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:43.253640 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:43.254491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.254773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.255048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] PATH_INFO: `/v3/projects/0ea074840325482c9aab0e12e50024c5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.256257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea074840325482c9aab0e12e50024c5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:43.258454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:43.305269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea074840325482c9aab0e12e50024c5', 'request_id': 'req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:43.310809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea074840325482c9aab0e12e50024c5', 'request_id': 'req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:43.317446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea074840325482c9aab0e12e50024c5', 'request_id': 'req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:43.331073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] The token cache is being invalidate because project 0ea074840325482c9aab0e12e50024c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:35:43.331362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:43.332011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bda8ad14-7e5d-4412-95c7-5e0d470a3d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:43.333774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1273/2558] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:35:43 2022] DELETE /identity/v3/projects/0ea074840325482c9aab0e12e50024c5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:43.338819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859ef5-d582-4b8e-872b-d8d939c849f5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.339108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859ef5-d582-4b8e-872b-d8d939c849f5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.339386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859ef5-d582-4b8e-872b-d8d939c849f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.358533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b9859ef5-d582-4b8e-872b-d8d939c849f5 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:43.359723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b9859ef5-d582-4b8e-872b-d8d939c849f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:43.421437 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1286/2559] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:43.429353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782c33-2ba8-4b27-ba9d-e6d02e17bfac None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.429700 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782c33-2ba8-4b27-ba9d-e6d02e17bfac None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.430077 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782c33-2ba8-4b27-ba9d-e6d02e17bfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.453419 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-87782c33-2ba8-4b27-ba9d-e6d02e17bfac None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:43.454659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87782c33-2ba8-4b27-ba9d-e6d02e17bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:43.463183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1274/2560] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:43.467815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9859ef5-d582-4b8e-872b-d8d939c849f5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:43.479185 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9859ef5-d582-4b8e-872b-d8d939c849f5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:43.485362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55674b0f-2f87-491c-b680-8db0f1f3e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:43.486030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55674b0f-2f87-491c-b680-8db0f1f3e6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.486348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55674b0f-2f87-491c-b680-8db0f1f3e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.486597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55674b0f-2f87-491c-b680-8db0f1f3e6c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.487317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55674b0f-2f87-491c-b680-8db0f1f3e6c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:35:43.487626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55674b0f-2f87-491c-b680-8db0f1f3e6c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:43.489320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55674b0f-2f87-491c-b680-8db0f1f3e6c6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:43.501956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1287/2561] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:35:43.506517 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782c33-2ba8-4b27-ba9d-e6d02e17bfac None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:43.516083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782c33-2ba8-4b27-ba9d-e6d02e17bfac None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:43.522032 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4cadf-c3e9-4487-8603-07e3bde1014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:43.522729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4cadf-c3e9-4487-8603-07e3bde1014b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.523014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4cadf-c3e9-4487-8603-07e3bde1014b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.523351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4cadf-c3e9-4487-8603-07e3bde1014b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.524145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4cadf-c3e9-4487-8603-07e3bde1014b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:43.526146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4cadf-c3e9-4487-8603-07e3bde1014b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:43.557388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1275/2562] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:35:43 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:43.561754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55674b0f-2f87-491c-b680-8db0f1f3e6c6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:43.571984 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55674b0f-2f87-491c-b680-8db0f1f3e6c6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:43.628753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33496a7f-595f-488b-bd00-30fe5545efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:43.629442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33496a7f-595f-488b-bd00-30fe5545efb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.629728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33496a7f-595f-488b-bd00-30fe5545efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.630005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33496a7f-595f-488b-bd00-30fe5545efb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.630721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33496a7f-595f-488b-bd00-30fe5545efb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:43.632713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33496a7f-595f-488b-bd00-30fe5545efb6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:43.640148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:43.656639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1288/2563] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:35:43 2022] POST /identity/v3/users => generated 278 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:43.657988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4cadf-c3e9-4487-8603-07e3bde1014b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:43.668649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4cadf-c3e9-4487-8603-07e3bde1014b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:43.673175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db882c6-6f12-4b4e-ab75-be8a07f37053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:43.673836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db882c6-6f12-4b4e-ab75-be8a07f37053 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.674117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db882c6-6f12-4b4e-ab75-be8a07f37053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.674421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db882c6-6f12-4b4e-ab75-be8a07f37053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.675176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db882c6-6f12-4b4e-ab75-be8a07f37053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:43.676795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db882c6-6f12-4b4e-ab75-be8a07f37053 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:43.687330 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1276/2564] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:35:43.691119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33496a7f-595f-488b-bd00-30fe5545efb6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:43.703821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33496a7f-595f-488b-bd00-30fe5545efb6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:43.709086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99ea4c-ed67-46f1-bf41-60741d1075e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:43.709751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99ea4c-ed67-46f1-bf41-60741d1075e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.710055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99ea4c-ed67-46f1-bf41-60741d1075e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.710362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99ea4c-ed67-46f1-bf41-60741d1075e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.711115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99ea4c-ed67-46f1-bf41-60741d1075e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:43.712747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99ea4c-ed67-46f1-bf41-60741d1075e5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:43.724088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1289/2565] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:35:43.728471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db882c6-6f12-4b4e-ab75-be8a07f37053 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:43.734361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:43.740360 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db882c6-6f12-4b4e-ab75-be8a07f37053 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:43.746750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4a8d8-b087-45e2-8b8c-b5ceade4f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:43.747788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4a8d8-b087-45e2-8b8c-b5ceade4f8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.748110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4a8d8-b087-45e2-8b8c-b5ceade4f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.748393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4a8d8-b087-45e2-8b8c-b5ceade4f8e1 admin admin] PATH_INFO: `/v3/projects/4c2133a7cdfb48549d4b489b5a71214e/users/eda5344ae4244d06b6f07e465d93a14a/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.764456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4a8d8-b087-45e2-8b8c-b5ceade4f8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2133a7cdfb48549d4b489b5a71214e, user_id=eda5344ae4244d06b6f07e465d93a14a, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:43.767152 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4a8d8-b087-45e2-8b8c-b5ceade4f8e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:43.783093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1277/2566] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:35:43 2022] PUT /identity/v3/projects/4c2133a7cdfb48549d4b489b5a71214e/users/eda5344ae4244d06b6f07e465d93a14a/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:43.794447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d636d7-e6a8-43bc-9bff-61d9865f0611 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.794850 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d636d7-e6a8-43bc-9bff-61d9865f0611 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.795295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d636d7-e6a8-43bc-9bff-61d9865f0611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.830692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-17d636d7-e6a8-43bc-9bff-61d9865f0611 None None] MFA Rules not processed for user `eda5344ae4244d06b6f07e465d93a14a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:43.832385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-17d636d7-e6a8-43bc-9bff-61d9865f0611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:43.905027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1290/2567] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:43 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:43.909643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4a8d8-b087-45e2-8b8c-b5ceade4f8e1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:43.976455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4a8d8-b087-45e2-8b8c-b5ceade4f8e1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:43.982112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb73419-7b41-4f91-8f1c-6701ed593cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:43.982783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb73419-7b41-4f91-8f1c-6701ed593cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:43.983067 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb73419-7b41-4f91-8f1c-6701ed593cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:43.983367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb73419-7b41-4f91-8f1c-6701ed593cc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:43.984230 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb73419-7b41-4f91-8f1c-6701ed593cc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:43.986237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb73419-7b41-4f91-8f1c-6701ed593cc3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:44.021841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1278/2568] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:35:43 2022] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:44.026024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d636d7-e6a8-43bc-9bff-61d9865f0611 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:44.037742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d636d7-e6a8-43bc-9bff-61d9865f0611 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:44.094658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8970aa-853d-499b-8353-f157f183c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:44.095328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8970aa-853d-499b-8353-f157f183c67a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:44.095606 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8970aa-853d-499b-8353-f157f183c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:44.095877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8970aa-853d-499b-8353-f157f183c67a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:44.096557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8970aa-853d-499b-8353-f157f183c67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:44.098569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8970aa-853d-499b-8353-f157f183c67a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:44.126821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1291/2569] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:35:44 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:35:44.130760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb73419-7b41-4f91-8f1c-6701ed593cc3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:44.143257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb73419-7b41-4f91-8f1c-6701ed593cc3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:44.149229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfd60e-7160-4b03-b99b-00c502322c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:44.149910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfd60e-7160-4b03-b99b-00c502322c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:44.150236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfd60e-7160-4b03-b99b-00c502322c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:44.150514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfd60e-7160-4b03-b99b-00c502322c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:44.151246 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfd60e-7160-4b03-b99b-00c502322c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:44.152867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfd60e-7160-4b03-b99b-00c502322c6b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:44.164670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1279/2570] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:35:44.169752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8970aa-853d-499b-8353-f157f183c67a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:44.184573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8970aa-853d-499b-8353-f157f183c67a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:44.189770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63043556-c635-43a7-b114-ba174608cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:44.190715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63043556-c635-43a7-b114-ba174608cd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:44.191000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63043556-c635-43a7-b114-ba174608cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:44.191273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63043556-c635-43a7-b114-ba174608cd7a admin admin] PATH_INFO: `/v3/projects/9bdc352b0b1e49799d94cd50d9891756/users/ee33c8dd41e24b5b95eb4c66c47ab13c/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:44.206859 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63043556-c635-43a7-b114-ba174608cd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdc352b0b1e49799d94cd50d9891756, user_id=ee33c8dd41e24b5b95eb4c66c47ab13c, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:44.209611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63043556-c635-43a7-b114-ba174608cd7a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:44.224788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1292/2571] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:35:44 2022] PUT /identity/v3/projects/9bdc352b0b1e49799d94cd50d9891756/users/ee33c8dd41e24b5b95eb4c66c47ab13c/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:44.230420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfd60e-7160-4b03-b99b-00c502322c6b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:44.246425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfd60e-7160-4b03-b99b-00c502322c6b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:44.307237 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab7579-420c-4314-9fdd-bb9421bc6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:44.307942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab7579-420c-4314-9fdd-bb9421bc6fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:44.308233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab7579-420c-4314-9fdd-bb9421bc6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:44.308545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab7579-420c-4314-9fdd-bb9421bc6fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:44.309294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab7579-420c-4314-9fdd-bb9421bc6fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:44.310976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab7579-420c-4314-9fdd-bb9421bc6fe4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:44.321964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1280/2572] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:35:44.326223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63043556-c635-43a7-b114-ba174608cd7a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:44.337218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63043556-c635-43a7-b114-ba174608cd7a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:44.342199 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6b61-2d65-4cb6-aa82-2c7c19a51b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:44.343099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6b61-2d65-4cb6-aa82-2c7c19a51b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:44.343381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6b61-2d65-4cb6-aa82-2c7c19a51b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:44.343666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6b61-2d65-4cb6-aa82-2c7c19a51b09 admin admin] PATH_INFO: `/v3/projects/9bdc352b0b1e49799d94cd50d9891756/users/ee33c8dd41e24b5b95eb4c66c47ab13c/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:44.345711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6b61-2d65-4cb6-aa82-2c7c19a51b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdc352b0b1e49799d94cd50d9891756, user_id=ee33c8dd41e24b5b95eb4c66c47ab13c, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:44.348478 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6b61-2d65-4cb6-aa82-2c7c19a51b09 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:44.359637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1293/2573] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:35:44 2022] PUT /identity/v3/projects/9bdc352b0b1e49799d94cd50d9891756/users/ee33c8dd41e24b5b95eb4c66c47ab13c/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:44.371060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab605f04-20a5-492f-b500-935848f3084d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:44.371349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab605f04-20a5-492f-b500-935848f3084d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:44.371633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab605f04-20a5-492f-b500-935848f3084d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:44.404452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ab605f04-20a5-492f-b500-935848f3084d None None] MFA Rules not processed for user `ee33c8dd41e24b5b95eb4c66c47ab13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:35:44.405690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ab605f04-20a5-492f-b500-935848f3084d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:44.446896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:44.480323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1281/2574] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:35:44 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:35:44.495068 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6b61-2d65-4cb6-aa82-2c7c19a51b09 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:44.498165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b2bd6b61-2d65-4cb6-aa82-2c7c19a51b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:44.528818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:44.561264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6b61-2d65-4cb6-aa82-2c7c19a51b09 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:44.565081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c8cd-bd76-4f74-a115-bce8bb2c61fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:44.565731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c8cd-bd76-4f74-a115-bce8bb2c61fc service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:44.566014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c8cd-bd76-4f74-a115-bce8bb2c61fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:44.566321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c8cd-bd76-4f74-a115-bce8bb2c61fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:44.575690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5c8cd-bd76-4f74-a115-bce8bb2c61fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:44.577160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5c8cd-bd76-4f74-a115-bce8bb2c61fc service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:44.586675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1294/2575] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:44 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:44.661734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab605f04-20a5-492f-b500-935848f3084d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:44.663349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ab605f04-20a5-492f-b500-935848f3084d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:44.678707 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab605f04-20a5-492f-b500-935848f3084d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:44.683217 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f1409-eca1-4c22-821e-c11d1226c86c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:44.683609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f1409-eca1-4c22-821e-c11d1226c86c service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:44.683892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f1409-eca1-4c22-821e-c11d1226c86c service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:44.684148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f1409-eca1-4c22-821e-c11d1226c86c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:44.751001 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f1409-eca1-4c22-821e-c11d1226c86c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:44.753210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f1409-eca1-4c22-821e-c11d1226c86c service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:44.764042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1282/2576] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:44 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:54.582971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=16 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:54.760156 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=40 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:56.604681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c8cd-bd76-4f74-a115-bce8bb2c61fc service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:56.606500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-42a5c8cd-bd76-4f74-a115-bce8bb2c61fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:56.672766 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c8cd-bd76-4f74-a115-bce8bb2c61fc service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:56.678216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cf86d-a311-46c4-869d-0673269007d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:56.679112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cf86d-a311-46c4-869d-0673269007d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:56.679396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cf86d-a311-46c4-869d-0673269007d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:56.679686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cf86d-a311-46c4-869d-0673269007d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:56.682747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d64cf86d-a311-46c4-869d-0673269007d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:56.747867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cf86d-a311-46c4-869d-0673269007d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:56.749386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cf86d-a311-46c4-869d-0673269007d3 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:56.760017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1295/2577] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:35:57.291197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f1409-eca1-4c22-821e-c11d1226c86c service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:57.292676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a56f1409-eca1-4c22-821e-c11d1226c86c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:35:57.309815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f1409-eca1-4c22-821e-c11d1226c86c service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:57.314744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:57.315725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:57.316080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:57.316537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] PATH_INFO: `/v3/users/c6bc5146c28948c5859cd9eb3d09e0cf` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:57.317869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bc5146c28948c5859cd9eb3d09e0cf)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:57.319897 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:57.371338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bc5146c28948c5859cd9eb3d09e0cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.384387 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bc5146c28948c5859cd9eb3d09e0cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.385160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bc5146c28948c5859cd9eb3d09e0cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.393090 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bc5146c28948c5859cd9eb3d09e0cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.400409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bc5146c28948c5859cd9eb3d09e0cf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.406512 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1283/2578] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:35:57 2022] DELETE /identity/v3/users/c6bc5146c28948c5859cd9eb3d09e0cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:35:57.580970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cf86d-a311-46c4-869d-0673269007d3 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:35:57.591760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cf86d-a311-46c4-869d-0673269007d3 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:35:57.648774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:35:57.649585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:35:57.649868 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:35:57.650209 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] PATH_INFO: `/v3/projects/834ac53907e54975851947e5f653c688` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:35:57.651444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=834ac53907e54975851947e5f653c688)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:35:57.653394 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:35:57.700168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834ac53907e54975851947e5f653c688', 'request_id': 'req-78eab816-af46-484d-a089-59214f98cb0d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.702027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:35:57.706860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834ac53907e54975851947e5f653c688', 'request_id': 'req-78eab816-af46-484d-a089-59214f98cb0d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.715284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834ac53907e54975851947e5f653c688', 'request_id': 'req-78eab816-af46-484d-a089-59214f98cb0d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.726256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] The token cache is being invalidate because project 834ac53907e54975851947e5f653c688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:35:57.726624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.727262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78eab816-af46-484d-a089-59214f98cb0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:35:57.728815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1296/2579] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:35:57 2022] DELETE /identity/v3/projects/834ac53907e54975851947e5f653c688 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:00.779060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:00.780528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:00.793593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4902b0-9fa7-431d-865e-7ead7b2ccb3a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:00.853129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:00.854020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:00.854332 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:00.854609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] PATH_INFO: `/v3/users/eda5344ae4244d06b6f07e465d93a14a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:00.856157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda5344ae4244d06b6f07e465d93a14a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:00.858120 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:00.904682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda5344ae4244d06b6f07e465d93a14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:00.916351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda5344ae4244d06b6f07e465d93a14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:00.917007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda5344ae4244d06b6f07e465d93a14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:00.925861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda5344ae4244d06b6f07e465d93a14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:00.928195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:00.935489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda5344ae4244d06b6f07e465d93a14a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:00.941792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1284/2580] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:36:00 2022] DELETE /identity/v3/users/eda5344ae4244d06b6f07e465d93a14a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:36:00.946999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b118f-9e3f-49c5-8807-8b7e8031b804 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:00.947455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b118f-9e3f-49c5-8807-8b7e8031b804 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:00.947564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b118f-9e3f-49c5-8807-8b7e8031b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:00.966208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1c5b118f-9e3f-49c5-8807-8b7e8031b804 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:00.967369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1c5b118f-9e3f-49c5-8807-8b7e8031b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:01.040452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1297/2581] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:36:01.050335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:01.051812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:01.110766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42389fd9-16f6-4c02-966c-dca5008ddd9d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:01.115141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a611da-73fb-438a-a7be-ffa837f58f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:01.115801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a611da-73fb-438a-a7be-ffa837f58f27 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:01.116109 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a611da-73fb-438a-a7be-ffa837f58f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:01.116417 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a611da-73fb-438a-a7be-ffa837f58f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:01.126187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a611da-73fb-438a-a7be-ffa837f58f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:01.127661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a611da-73fb-438a-a7be-ffa837f58f27 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:01.137869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1285/2582] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:01.434482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b118f-9e3f-49c5-8807-8b7e8031b804 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:01.436006 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1c5b118f-9e3f-49c5-8807-8b7e8031b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:01.448951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b118f-9e3f-49c5-8807-8b7e8031b804 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:01.453778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:01.454728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:01.455015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:01.455291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] PATH_INFO: `/v3/projects/4c2133a7cdfb48549d4b489b5a71214e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:01.456621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2133a7cdfb48549d4b489b5a71214e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:01.458622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:01.508688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2133a7cdfb48549d4b489b5a71214e', 'request_id': 'req-41a8054c-a578-499e-8af5-d4a02886bc17'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.514967 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2133a7cdfb48549d4b489b5a71214e', 'request_id': 'req-41a8054c-a578-499e-8af5-d4a02886bc17'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.524036 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2133a7cdfb48549d4b489b5a71214e', 'request_id': 'req-41a8054c-a578-499e-8af5-d4a02886bc17'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.535446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] The token cache is being invalidate because project 4c2133a7cdfb48549d4b489b5a71214e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:36:01.535727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.536389 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.537950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1298/2583] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:36:01 2022] DELETE /identity/v3/projects/4c2133a7cdfb48549d4b489b5a71214e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:01.542407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a611da-73fb-438a-a7be-ffa837f58f27 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:01.551989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a611da-73fb-438a-a7be-ffa837f58f27 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:01.610312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:01.611211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:01.611492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:01.611766 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] PATH_INFO: `/v3/users/ee33c8dd41e24b5b95eb4c66c47ab13c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:01.612996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee33c8dd41e24b5b95eb4c66c47ab13c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:01.614998 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:01.665701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee33c8dd41e24b5b95eb4c66c47ab13c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.678013 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee33c8dd41e24b5b95eb4c66c47ab13c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.679193 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee33c8dd41e24b5b95eb4c66c47ab13c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.689121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee33c8dd41e24b5b95eb4c66c47ab13c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.696807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fafa7f97-915d-4ac1-bb10-5a2bf09893df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee33c8dd41e24b5b95eb4c66c47ab13c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:01.702762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1286/2584] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:36:01 2022] DELETE /identity/v3/users/ee33c8dd41e24b5b95eb4c66c47ab13c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:01.995608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:01.997125 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:02.012553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8054c-a578-499e-8af5-d4a02886bc17 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:02.080031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:02.080925 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.081202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.081473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] PATH_INFO: `/v3/projects/9bdc352b0b1e49799d94cd50d9891756` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.082883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdc352b0b1e49799d94cd50d9891756)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:02.084862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:02.091688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:02.134211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdc352b0b1e49799d94cd50d9891756', 'request_id': 'req-20305227-d8f0-4594-bc60-b5bdc39b6eba'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:02.140492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdc352b0b1e49799d94cd50d9891756', 'request_id': 'req-20305227-d8f0-4594-bc60-b5bdc39b6eba'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:02.150215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdc352b0b1e49799d94cd50d9891756', 'request_id': 'req-20305227-d8f0-4594-bc60-b5bdc39b6eba'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:02.164497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] The token cache is being invalidate because project 9bdc352b0b1e49799d94cd50d9891756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:36:02.164843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:02.165789 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-20305227-d8f0-4594-bc60-b5bdc39b6eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:02.167753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1299/2585] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:36:01 2022] DELETE /identity/v3/projects/9bdc352b0b1e49799d94cd50d9891756 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:02.172702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080595-e31e-4e5d-9a34-e0b14a6ac99a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.173184 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080595-e31e-4e5d-9a34-e0b14a6ac99a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.173282 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080595-e31e-4e5d-9a34-e0b14a6ac99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.194549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-50080595-e31e-4e5d-9a34-e0b14a6ac99a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:02.195883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-50080595-e31e-4e5d-9a34-e0b14a6ac99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:02.206884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:02.260581 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1287/2586] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:02.268682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfc63-35ec-400e-af0f-358ea8cb4c9b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.268983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfc63-35ec-400e-af0f-358ea8cb4c9b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.269259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfc63-35ec-400e-af0f-358ea8cb4c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.289423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f1edfc63-35ec-400e-af0f-358ea8cb4c9b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:02.290781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f1edfc63-35ec-400e-af0f-358ea8cb4c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:02.299418 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1300/2587] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:02.303664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080595-e31e-4e5d-9a34-e0b14a6ac99a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:02.314524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080595-e31e-4e5d-9a34-e0b14a6ac99a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:02.320609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae45ca-a4c8-48a4-88ea-8980062238c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:02.321334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae45ca-a4c8-48a4-88ea-8980062238c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.321685 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae45ca-a4c8-48a4-88ea-8980062238c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.322057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae45ca-a4c8-48a4-88ea-8980062238c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.323290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae45ca-a4c8-48a4-88ea-8980062238c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:36:02.323696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae45ca-a4c8-48a4-88ea-8980062238c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:02.326301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae45ca-a4c8-48a4-88ea-8980062238c2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:02.341838 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1288/2588] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:36:02.346294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfc63-35ec-400e-af0f-358ea8cb4c9b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:02.356189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfc63-35ec-400e-af0f-358ea8cb4c9b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:02.361210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984510cd-5a7a-447a-bcce-c4520b02a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:02.361833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984510cd-5a7a-447a-bcce-c4520b02a10c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.362137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984510cd-5a7a-447a-bcce-c4520b02a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.362415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984510cd-5a7a-447a-bcce-c4520b02a10c admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.363102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984510cd-5a7a-447a-bcce-c4520b02a10c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:02.365066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984510cd-5a7a-447a-bcce-c4520b02a10c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:02.392871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1301/2589] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:36:02 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:02.397697 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae45ca-a4c8-48a4-88ea-8980062238c2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:02.408554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae45ca-a4c8-48a4-88ea-8980062238c2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:02.470069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd974f8c-6a7b-441b-8d6d-2d982495556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:02.470801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd974f8c-6a7b-441b-8d6d-2d982495556f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.471084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd974f8c-6a7b-441b-8d6d-2d982495556f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.471385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd974f8c-6a7b-441b-8d6d-2d982495556f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.472082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd974f8c-6a7b-441b-8d6d-2d982495556f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:02.474025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd974f8c-6a7b-441b-8d6d-2d982495556f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:02.495320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1289/2590] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:36:02 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:02.499473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984510cd-5a7a-447a-bcce-c4520b02a10c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:02.510305 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984510cd-5a7a-447a-bcce-c4520b02a10c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:02.515814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dbf25-6325-4370-b94a-d45e7dfece27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:02.516571 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dbf25-6325-4370-b94a-d45e7dfece27 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.516858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dbf25-6325-4370-b94a-d45e7dfece27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.517137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dbf25-6325-4370-b94a-d45e7dfece27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.517861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dbf25-6325-4370-b94a-d45e7dfece27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:02.519700 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dbf25-6325-4370-b94a-d45e7dfece27 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:02.531431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1302/2591] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:02.535268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd974f8c-6a7b-441b-8d6d-2d982495556f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:02.545759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd974f8c-6a7b-441b-8d6d-2d982495556f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:02.550385 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158f13c-fd16-4f1e-a581-977418682c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:02.551053 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f13c-fd16-4f1e-a581-977418682c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.551336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f13c-fd16-4f1e-a581-977418682c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.551617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f13c-fd16-4f1e-a581-977418682c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.552350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158f13c-fd16-4f1e-a581-977418682c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:02.553965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158f13c-fd16-4f1e-a581-977418682c1f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:02.564876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1290/2592] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:02.568885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dbf25-6325-4370-b94a-d45e7dfece27 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:02.579820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dbf25-6325-4370-b94a-d45e7dfece27 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:02.584543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a104d-478b-4656-80aa-2069cac3788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:02.585646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a104d-478b-4656-80aa-2069cac3788e admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.586564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a104d-478b-4656-80aa-2069cac3788e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.586885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a104d-478b-4656-80aa-2069cac3788e admin admin] PATH_INFO: `/v3/projects/0b00acf3863f4096acdc837eb6e3bf16/users/544caaaafb1a4f7b8f52666a5703d733/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.604108 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a104d-478b-4656-80aa-2069cac3788e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b00acf3863f4096acdc837eb6e3bf16, user_id=544caaaafb1a4f7b8f52666a5703d733, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:02.607293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a104d-478b-4656-80aa-2069cac3788e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:02.621938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1303/2593] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:36:02 2022] PUT /identity/v3/projects/0b00acf3863f4096acdc837eb6e3bf16/users/544caaaafb1a4f7b8f52666a5703d733/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:02.683264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dfe0b-146c-44e0-8833-faf1347dec31 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.683520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dfe0b-146c-44e0-8833-faf1347dec31 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.683828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dfe0b-146c-44e0-8833-faf1347dec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.712257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a41dfe0b-146c-44e0-8833-faf1347dec31 None None] MFA Rules not processed for user `544caaaafb1a4f7b8f52666a5703d733`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:02.713493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a41dfe0b-146c-44e0-8833-faf1347dec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:02.786220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1291/2594] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:02.790936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a104d-478b-4656-80aa-2069cac3788e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:02.858524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a104d-478b-4656-80aa-2069cac3788e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:02.863794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7629246-85d4-4987-8fe6-fa87740a0aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:02.864464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7629246-85d4-4987-8fe6-fa87740a0aee admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.864812 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7629246-85d4-4987-8fe6-fa87740a0aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.865102 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7629246-85d4-4987-8fe6-fa87740a0aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.865796 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7629246-85d4-4987-8fe6-fa87740a0aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:02.868043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7629246-85d4-4987-8fe6-fa87740a0aee admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:02.895596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1304/2595] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:36:02 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:02.899837 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dfe0b-146c-44e0-8833-faf1347dec31 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:02.910711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dfe0b-146c-44e0-8833-faf1347dec31 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:02.915414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:02.967683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da79f61-bf2c-45df-b8cd-4943811f32b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:02.968372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da79f61-bf2c-45df-b8cd-4943811f32b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:02.968633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da79f61-bf2c-45df-b8cd-4943811f32b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:02.968903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da79f61-bf2c-45df-b8cd-4943811f32b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:02.969598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da79f61-bf2c-45df-b8cd-4943811f32b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:02.971574 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da79f61-bf2c-45df-b8cd-4943811f32b6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:02.996043 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1292/2596] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:36:02 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:03.000049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7629246-85d4-4987-8fe6-fa87740a0aee admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:03.010785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7629246-85d4-4987-8fe6-fa87740a0aee admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:03.016107 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab79999-72dd-41db-869d-5d4a037d61af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:03.016773 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab79999-72dd-41db-869d-5d4a037d61af admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:03.017054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab79999-72dd-41db-869d-5d4a037d61af admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:03.017327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab79999-72dd-41db-869d-5d4a037d61af admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:03.018048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab79999-72dd-41db-869d-5d4a037d61af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:03.019710 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab79999-72dd-41db-869d-5d4a037d61af admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:03.030749 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1305/2597] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:03.034975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da79f61-bf2c-45df-b8cd-4943811f32b6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:03.045711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da79f61-bf2c-45df-b8cd-4943811f32b6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:03.051753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852db46-f38f-4392-8fb0-a156df4eb21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:03.052653 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852db46-f38f-4392-8fb0-a156df4eb21d admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:03.052938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852db46-f38f-4392-8fb0-a156df4eb21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:03.053216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852db46-f38f-4392-8fb0-a156df4eb21d admin admin] PATH_INFO: `/v3/projects/ef6796deb18447588c7565e1cabf1b98/users/7cb634260bc545d3922c5eda987cc7de/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:03.069569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852db46-f38f-4392-8fb0-a156df4eb21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6796deb18447588c7565e1cabf1b98, user_id=7cb634260bc545d3922c5eda987cc7de, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:03.072304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852db46-f38f-4392-8fb0-a156df4eb21d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:03.088649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1293/2598] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:36:03 2022] PUT /identity/v3/projects/ef6796deb18447588c7565e1cabf1b98/users/7cb634260bc545d3922c5eda987cc7de/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:03.092653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab79999-72dd-41db-869d-5d4a037d61af admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:03.099079 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:03.102995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab79999-72dd-41db-869d-5d4a037d61af admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:03.164101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dcef1-bba9-4788-9273-d4c3c1596967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:03.164767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcef1-bba9-4788-9273-d4c3c1596967 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:03.165048 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcef1-bba9-4788-9273-d4c3c1596967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:03.165282 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcef1-bba9-4788-9273-d4c3c1596967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:03.166061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dcef1-bba9-4788-9273-d4c3c1596967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:03.167736 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dcef1-bba9-4788-9273-d4c3c1596967 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:03.177678 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1306/2599] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:03.182051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852db46-f38f-4392-8fb0-a156df4eb21d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:03.192900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852db46-f38f-4392-8fb0-a156df4eb21d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:03.197731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309cd31-3c6b-4cad-b73d-b8f950e8ccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:03.198664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309cd31-3c6b-4cad-b73d-b8f950e8ccd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:03.198945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309cd31-3c6b-4cad-b73d-b8f950e8ccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:03.199225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309cd31-3c6b-4cad-b73d-b8f950e8ccd5 admin admin] PATH_INFO: `/v3/projects/ef6796deb18447588c7565e1cabf1b98/users/7cb634260bc545d3922c5eda987cc7de/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:03.201216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309cd31-3c6b-4cad-b73d-b8f950e8ccd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6796deb18447588c7565e1cabf1b98, user_id=7cb634260bc545d3922c5eda987cc7de, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:03.203934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309cd31-3c6b-4cad-b73d-b8f950e8ccd5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:03.214492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1294/2600] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:36:03 2022] PUT /identity/v3/projects/ef6796deb18447588c7565e1cabf1b98/users/7cb634260bc545d3922c5eda987cc7de/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:03.224533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454800a-1fb3-496b-991d-916f6d059bc2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:03.224825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454800a-1fb3-496b-991d-916f6d059bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:03.225103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454800a-1fb3-496b-991d-916f6d059bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:03.252198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c454800a-1fb3-496b-991d-916f6d059bc2 None None] MFA Rules not processed for user `7cb634260bc545d3922c5eda987cc7de`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:03.253396 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c454800a-1fb3-496b-991d-916f6d059bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:03.330800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1307/2601] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:03.342232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309cd31-3c6b-4cad-b73d-b8f950e8ccd5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:03.344113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c309cd31-3c6b-4cad-b73d-b8f950e8ccd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:03.405338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309cd31-3c6b-4cad-b73d-b8f950e8ccd5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:03.409923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3e69a-7704-4c1a-a7ba-ee4ef170067e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:03.410614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3e69a-7704-4c1a-a7ba-ee4ef170067e service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:03.410898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3e69a-7704-4c1a-a7ba-ee4ef170067e service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:03.411207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3e69a-7704-4c1a-a7ba-ee4ef170067e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:03.469799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3e69a-7704-4c1a-a7ba-ee4ef170067e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:03.471222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3e69a-7704-4c1a-a7ba-ee4ef170067e service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:03.481457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1295/2602] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:10.201997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454800a-1fb3-496b-991d-916f6d059bc2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:10.212053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454800a-1fb3-496b-991d-916f6d059bc2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:10.215968 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d236ad-1099-4586-9e28-8f6867da0bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:10.216617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d236ad-1099-4586-9e28-8f6867da0bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:10.216900 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d236ad-1099-4586-9e28-8f6867da0bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:10.217176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d236ad-1099-4586-9e28-8f6867da0bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:10.226771 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d236ad-1099-4586-9e28-8f6867da0bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:10.228188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d236ad-1099-4586-9e28-8f6867da0bb1 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:10.238114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1308/2603] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:13.476522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:20.233998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=67 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:39.439087 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3e69a-7704-4c1a-a7ba-ee4ef170067e service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:39.505202 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3e69a-7704-4c1a-a7ba-ee4ef170067e service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:39.510618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:39.511537 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:39.511815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:39.512060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] PATH_INFO: `/v3/users/544caaaafb1a4f7b8f52666a5703d733` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:39.513321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544caaaafb1a4f7b8f52666a5703d733)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:39.515304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:39.565395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544caaaafb1a4f7b8f52666a5703d733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:39.577913 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544caaaafb1a4f7b8f52666a5703d733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:39.578623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544caaaafb1a4f7b8f52666a5703d733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:39.596340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544caaaafb1a4f7b8f52666a5703d733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:39.603277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544caaaafb1a4f7b8f52666a5703d733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:39.609459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1296/2604] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:36:39 2022] DELETE /identity/v3/users/544caaaafb1a4f7b8f52666a5703d733 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:39.613939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ac1d-ef26-4295-9889-ac27b8b227e9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:39.614477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ac1d-ef26-4295-9889-ac27b8b227e9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:39.614477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ac1d-ef26-4295-9889-ac27b8b227e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:39.632141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3a61ac1d-ef26-4295-9889-ac27b8b227e9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:39.633370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3a61ac1d-ef26-4295-9889-ac27b8b227e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:39.709512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1309/2605] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:39.719606 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:39.721315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:39.785611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717cf07-ace3-4bf3-ba99-e64b394cced5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:39.790646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02fb1f-6603-42bd-9811-0f1f969b53b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:39.791302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02fb1f-6603-42bd-9811-0f1f969b53b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:39.791583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02fb1f-6603-42bd-9811-0f1f969b53b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:39.791865 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02fb1f-6603-42bd-9811-0f1f969b53b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:39.802835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02fb1f-6603-42bd-9811-0f1f969b53b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:39.804620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02fb1f-6603-42bd-9811-0f1f969b53b3 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:39.814499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1297/2606] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:40.098178 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ac1d-ef26-4295-9889-ac27b8b227e9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:40.099592 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3a61ac1d-ef26-4295-9889-ac27b8b227e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:40.112519 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ac1d-ef26-4295-9889-ac27b8b227e9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:40.118321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:40.119350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:40.119620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:40.119981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] PATH_INFO: `/v3/projects/0b00acf3863f4096acdc837eb6e3bf16` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:40.121325 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b00acf3863f4096acdc837eb6e3bf16)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:40.123307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:40.175180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b00acf3863f4096acdc837eb6e3bf16', 'request_id': 'req-d28021af-db9e-4a47-9e59-411df807f2ad'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.181762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b00acf3863f4096acdc837eb6e3bf16', 'request_id': 'req-d28021af-db9e-4a47-9e59-411df807f2ad'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.189948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b00acf3863f4096acdc837eb6e3bf16', 'request_id': 'req-d28021af-db9e-4a47-9e59-411df807f2ad'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.201113 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] The token cache is being invalidate because project 0b00acf3863f4096acdc837eb6e3bf16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:36:40.201398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.202174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.203862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1310/2607] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:36:40 2022] DELETE /identity/v3/projects/0b00acf3863f4096acdc837eb6e3bf16 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:40.208139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02fb1f-6603-42bd-9811-0f1f969b53b3 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:40.219211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02fb1f-6603-42bd-9811-0f1f969b53b3 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:40.238861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:40.282448 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:40.283353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:40.283664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:40.283919 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] PATH_INFO: `/v3/users/7cb634260bc545d3922c5eda987cc7de` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:40.285110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb634260bc545d3922c5eda987cc7de)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:40.287273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:40.338799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb634260bc545d3922c5eda987cc7de'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.350274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb634260bc545d3922c5eda987cc7de'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.350870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb634260bc545d3922c5eda987cc7de'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.359485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb634260bc545d3922c5eda987cc7de'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.366558 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b38718e2-3ad4-44d9-82ac-6cf0a3760fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb634260bc545d3922c5eda987cc7de'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.372655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1298/2608] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:36:40 2022] DELETE /identity/v3/users/7cb634260bc545d3922c5eda987cc7de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:40.656476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:40.658834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:40.673380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28021af-db9e-4a47-9e59-411df807f2ad admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:40.736376 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:40.737272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:40.737555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:40.737955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] PATH_INFO: `/v3/projects/ef6796deb18447588c7565e1cabf1b98` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:40.739233 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6796deb18447588c7565e1cabf1b98)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:40.741721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:40.772795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:40.791189 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6796deb18447588c7565e1cabf1b98', 'request_id': 'req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.797335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6796deb18447588c7565e1cabf1b98', 'request_id': 'req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.805299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6796deb18447588c7565e1cabf1b98', 'request_id': 'req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.816529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] The token cache is being invalidate because project ef6796deb18447588c7565e1cabf1b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:36:40.816814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.817546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c34ee4a-b835-450e-82db-5b3c4eeb3a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:40.819363 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1311/2609] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:36:40 2022] DELETE /identity/v3/projects/ef6796deb18447588c7565e1cabf1b98 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:40.825204 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677147c-d0ff-4f06-8be6-124b697e47c3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:40.825663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677147c-d0ff-4f06-8be6-124b697e47c3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:40.825950 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677147c-d0ff-4f06-8be6-124b697e47c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:40.852475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a677147c-d0ff-4f06-8be6-124b697e47c3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:40.853677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a677147c-d0ff-4f06-8be6-124b697e47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:40.914082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1299/2610] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:40.922851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448087-d7f3-4fa3-a4a0-66602283f6c0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:40.923218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448087-d7f3-4fa3-a4a0-66602283f6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:40.923494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448087-d7f3-4fa3-a4a0-66602283f6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:40.943664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9a448087-d7f3-4fa3-a4a0-66602283f6c0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:40.945507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9a448087-d7f3-4fa3-a4a0-66602283f6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:40.954501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1312/2611] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:40.959045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677147c-d0ff-4f06-8be6-124b697e47c3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:40.970456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677147c-d0ff-4f06-8be6-124b697e47c3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:40.975906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5019ac5-81d2-4d7f-b8dd-0d5b9af386d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:40.976576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5019ac5-81d2-4d7f-b8dd-0d5b9af386d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:40.976858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5019ac5-81d2-4d7f-b8dd-0d5b9af386d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:40.977133 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5019ac5-81d2-4d7f-b8dd-0d5b9af386d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:40.977862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5019ac5-81d2-4d7f-b8dd-0d5b9af386d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:36:40.978203 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5019ac5-81d2-4d7f-b8dd-0d5b9af386d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:40.979816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5019ac5-81d2-4d7f-b8dd-0d5b9af386d6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:40.992493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1300/2612] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:36:40.997010 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a448087-d7f3-4fa3-a4a0-66602283f6c0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.007188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a448087-d7f3-4fa3-a4a0-66602283f6c0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.012407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96e09-cfc6-406d-9616-c8069a689f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.013061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96e09-cfc6-406d-9616-c8069a689f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.013341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96e09-cfc6-406d-9616-c8069a689f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.013613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96e09-cfc6-406d-9616-c8069a689f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.014333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96e09-cfc6-406d-9616-c8069a689f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.016276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96e09-cfc6-406d-9616-c8069a689f1a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.050150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1313/2613] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:36:40 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:41.051675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5019ac5-81d2-4d7f-b8dd-0d5b9af386d6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.062908 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5019ac5-81d2-4d7f-b8dd-0d5b9af386d6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.091479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:41.125238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e93de-0f47-4747-8196-12a64f56406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.125926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e93de-0f47-4747-8196-12a64f56406a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.126242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e93de-0f47-4747-8196-12a64f56406a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.126523 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e93de-0f47-4747-8196-12a64f56406a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.127227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e93de-0f47-4747-8196-12a64f56406a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.129180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e93de-0f47-4747-8196-12a64f56406a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.150160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1301/2614] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:36:41 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:36:41.154353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96e09-cfc6-406d-9616-c8069a689f1a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.165160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96e09-cfc6-406d-9616-c8069a689f1a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.170659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21498e3-250b-4c37-a222-ba663c94eda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.171333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21498e3-250b-4c37-a222-ba663c94eda7 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.171616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21498e3-250b-4c37-a222-ba663c94eda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.171893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21498e3-250b-4c37-a222-ba663c94eda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.172621 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21498e3-250b-4c37-a222-ba663c94eda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.174292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21498e3-250b-4c37-a222-ba663c94eda7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.184923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1314/2615] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:41.189110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e93de-0f47-4747-8196-12a64f56406a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.200084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e93de-0f47-4747-8196-12a64f56406a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.205964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14dde2-b43e-4a40-a2c3-915779b47fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.206663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14dde2-b43e-4a40-a2c3-915779b47fde admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.206944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14dde2-b43e-4a40-a2c3-915779b47fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.207216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14dde2-b43e-4a40-a2c3-915779b47fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.207972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14dde2-b43e-4a40-a2c3-915779b47fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.209840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14dde2-b43e-4a40-a2c3-915779b47fde admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.220567 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1302/2616] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:41.225013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21498e3-250b-4c37-a222-ba663c94eda7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.235695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21498e3-250b-4c37-a222-ba663c94eda7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.240628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef676-0897-4c7b-9be8-090c58b96834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.241584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef676-0897-4c7b-9be8-090c58b96834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.241869 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef676-0897-4c7b-9be8-090c58b96834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.242143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef676-0897-4c7b-9be8-090c58b96834 admin admin] PATH_INFO: `/v3/projects/95209f450f9945e8bfc977202db0ec9b/users/f5c3de3d3d33444b81e66844338d4ad5/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.257101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ef676-0897-4c7b-9be8-090c58b96834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95209f450f9945e8bfc977202db0ec9b, user_id=f5c3de3d3d33444b81e66844338d4ad5, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.259892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ef676-0897-4c7b-9be8-090c58b96834 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.274040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1315/2617] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:36:41 2022] PUT /identity/v3/projects/95209f450f9945e8bfc977202db0ec9b/users/f5c3de3d3d33444b81e66844338d4ad5/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:36:41.284353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabc512-ffef-424d-b12a-c109c5def29b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.284649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabc512-ffef-424d-b12a-c109c5def29b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.284933 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabc512-ffef-424d-b12a-c109c5def29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.312342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ddabc512-ffef-424d-b12a-c109c5def29b None None] MFA Rules not processed for user `f5c3de3d3d33444b81e66844338d4ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:41.313498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ddabc512-ffef-424d-b12a-c109c5def29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:41.381678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1303/2618] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:41.386614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef676-0897-4c7b-9be8-090c58b96834 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.456801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef676-0897-4c7b-9be8-090c58b96834 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.462122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43d861-9f48-497f-9548-c3694947bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.462799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43d861-9f48-497f-9548-c3694947bb06 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.463080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43d861-9f48-497f-9548-c3694947bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.463348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43d861-9f48-497f-9548-c3694947bb06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.464021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43d861-9f48-497f-9548-c3694947bb06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.465950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43d861-9f48-497f-9548-c3694947bb06 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.493421 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1316/2619] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:36:41 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:41.499175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabc512-ffef-424d-b12a-c109c5def29b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.510402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabc512-ffef-424d-b12a-c109c5def29b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.566704 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f41a1-949a-4301-b2d9-1644548faa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.567383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f41a1-949a-4301-b2d9-1644548faa61 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.567671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f41a1-949a-4301-b2d9-1644548faa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.567952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f41a1-949a-4301-b2d9-1644548faa61 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.568645 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f41a1-949a-4301-b2d9-1644548faa61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.570709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f41a1-949a-4301-b2d9-1644548faa61 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.596980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1304/2620] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:36:41 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:41.602342 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43d861-9f48-497f-9548-c3694947bb06 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.614043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43d861-9f48-497f-9548-c3694947bb06 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.620093 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78b49-fa66-45c4-b6fc-0deaeaa21903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.620802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78b49-fa66-45c4-b6fc-0deaeaa21903 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.621082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78b49-fa66-45c4-b6fc-0deaeaa21903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.621355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78b49-fa66-45c4-b6fc-0deaeaa21903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.622112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c78b49-fa66-45c4-b6fc-0deaeaa21903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.623746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c78b49-fa66-45c4-b6fc-0deaeaa21903 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.635169 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1317/2621] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:41.641845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f41a1-949a-4301-b2d9-1644548faa61 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.654411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f41a1-949a-4301-b2d9-1644548faa61 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.660842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950525-fd2b-49e3-86e7-fff24edf221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.661750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950525-fd2b-49e3-86e7-fff24edf221b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.662058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950525-fd2b-49e3-86e7-fff24edf221b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.662372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950525-fd2b-49e3-86e7-fff24edf221b admin admin] PATH_INFO: `/v3/projects/14a127f5a88744829bc33773aeed1aee/users/8930db582843487c80bf46808d440ad6/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.678221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c950525-fd2b-49e3-86e7-fff24edf221b admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a127f5a88744829bc33773aeed1aee, user_id=8930db582843487c80bf46808d440ad6, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.680912 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c950525-fd2b-49e3-86e7-fff24edf221b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.695388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1305/2622] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:36:41 2022] PUT /identity/v3/projects/14a127f5a88744829bc33773aeed1aee/users/8930db582843487c80bf46808d440ad6/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:41.699330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78b49-fa66-45c4-b6fc-0deaeaa21903 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.710049 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78b49-fa66-45c4-b6fc-0deaeaa21903 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.732092 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:41.772562 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8efdf-0835-4228-8bdf-6b07ce05bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.773232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8efdf-0835-4228-8bdf-6b07ce05bdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.773518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8efdf-0835-4228-8bdf-6b07ce05bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.773798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8efdf-0835-4228-8bdf-6b07ce05bdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.774571 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8efdf-0835-4228-8bdf-6b07ce05bdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.776218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8efdf-0835-4228-8bdf-6b07ce05bdd9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.786311 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1318/2623] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:41.791192 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950525-fd2b-49e3-86e7-fff24edf221b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.796974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:41.803159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950525-fd2b-49e3-86e7-fff24edf221b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:41.808675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cbd6c-4ca5-4ed9-bcc8-3c26fa2bb70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:41.809578 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cbd6c-4ca5-4ed9-bcc8-3c26fa2bb70a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.809861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cbd6c-4ca5-4ed9-bcc8-3c26fa2bb70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.810159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cbd6c-4ca5-4ed9-bcc8-3c26fa2bb70a admin admin] PATH_INFO: `/v3/projects/14a127f5a88744829bc33773aeed1aee/users/8930db582843487c80bf46808d440ad6/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.812157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cbd6c-4ca5-4ed9-bcc8-3c26fa2bb70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a127f5a88744829bc33773aeed1aee, user_id=8930db582843487c80bf46808d440ad6, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:41.814886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cbd6c-4ca5-4ed9-bcc8-3c26fa2bb70a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:41.825439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1306/2624] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:36:41 2022] PUT /identity/v3/projects/14a127f5a88744829bc33773aeed1aee/users/8930db582843487c80bf46808d440ad6/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:36:41.835996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae92c3-7590-4116-992a-19b5c7bc71ca None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:41.836292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae92c3-7590-4116-992a-19b5c7bc71ca None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:41.836586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae92c3-7590-4116-992a-19b5c7bc71ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:41.864087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-93ae92c3-7590-4116-992a-19b5c7bc71ca None None] MFA Rules not processed for user `8930db582843487c80bf46808d440ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:41.865341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-93ae92c3-7590-4116-992a-19b5c7bc71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:41.933856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1319/2625] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:36:41.948993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cbd6c-4ca5-4ed9-bcc8-3c26fa2bb70a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:41.951121 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f81cbd6c-4ca5-4ed9-bcc8-3c26fa2bb70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:42.015822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cbd6c-4ca5-4ed9-bcc8-3c26fa2bb70a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:42.020034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a058ce9-b45f-4866-9d42-583aec642216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:42.020688 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a058ce9-b45f-4866-9d42-583aec642216 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:42.020969 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a058ce9-b45f-4866-9d42-583aec642216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:42.021248 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a058ce9-b45f-4866-9d42-583aec642216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:42.030901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a058ce9-b45f-4866-9d42-583aec642216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:42.032353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a058ce9-b45f-4866-9d42-583aec642216 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:42.041945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1307/2626] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:42.109845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae92c3-7590-4116-992a-19b5c7bc71ca None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:42.175351 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae92c3-7590-4116-992a-19b5c7bc71ca None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:42.179890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:42.180794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:42.181075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:42.181354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] PATH_INFO: `/v3/users/f5c3de3d3d33444b81e66844338d4ad5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:42.182584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c3de3d3d33444b81e66844338d4ad5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:42.184548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:42.237719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c3de3d3d33444b81e66844338d4ad5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.238459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c3de3d3d33444b81e66844338d4ad5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.239078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c3de3d3d33444b81e66844338d4ad5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.240360 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:42.248829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c3de3d3d33444b81e66844338d4ad5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.258114 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c3de3d3d33444b81e66844338d4ad5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.277480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1320/2627] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:36:42 2022] DELETE /identity/v3/users/f5c3de3d3d33444b81e66844338d4ad5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:42.282110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b65e3-361a-4b3f-919c-d01e79acf8e2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:42.282445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b65e3-361a-4b3f-919c-d01e79acf8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:42.282732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b65e3-361a-4b3f-919c-d01e79acf8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:42.300985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f43b65e3-361a-4b3f-919c-d01e79acf8e2 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:42.302240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f43b65e3-361a-4b3f-919c-d01e79acf8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:42.364050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1308/2628] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:42.374994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:42.376535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:42.435751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b157257-121d-4b39-be8a-c1716ff898c6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:42.439501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816198-863e-44a6-b621-398d9fc7b670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:42.440161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816198-863e-44a6-b621-398d9fc7b670 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:42.440443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816198-863e-44a6-b621-398d9fc7b670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:42.440721 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816198-863e-44a6-b621-398d9fc7b670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:42.450314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65816198-863e-44a6-b621-398d9fc7b670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:42.451793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65816198-863e-44a6-b621-398d9fc7b670 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:42.461913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1321/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:42.849605 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b65e3-361a-4b3f-919c-d01e79acf8e2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:42.851314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f43b65e3-361a-4b3f-919c-d01e79acf8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:42.864048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b65e3-361a-4b3f-919c-d01e79acf8e2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:42.868954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:42.869836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:42.870145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:42.870422 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] PATH_INFO: `/v3/projects/95209f450f9945e8bfc977202db0ec9b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:42.872113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=95209f450f9945e8bfc977202db0ec9b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:42.874277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:42.923678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95209f450f9945e8bfc977202db0ec9b', 'request_id': 'req-80478e2a-d667-4ee8-84b0-96887e1729ea'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.929215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95209f450f9945e8bfc977202db0ec9b', 'request_id': 'req-80478e2a-d667-4ee8-84b0-96887e1729ea'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.935395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95209f450f9945e8bfc977202db0ec9b', 'request_id': 'req-80478e2a-d667-4ee8-84b0-96887e1729ea'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.949162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] The token cache is being invalidate because project 95209f450f9945e8bfc977202db0ec9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:36:42.949423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.950100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:42.951667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1309/2630] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:36:42 2022] DELETE /identity/v3/projects/95209f450f9945e8bfc977202db0ec9b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:42.956604 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816198-863e-44a6-b621-398d9fc7b670 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:42.970339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816198-863e-44a6-b621-398d9fc7b670 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:43.033683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:43.034616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:43.034899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:43.035175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] PATH_INFO: `/v3/users/8930db582843487c80bf46808d440ad6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:43.036555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8930db582843487c80bf46808d440ad6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:43.039159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:43.090710 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8930db582843487c80bf46808d440ad6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.091269 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8930db582843487c80bf46808d440ad6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.091871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8930db582843487c80bf46808d440ad6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.098624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8930db582843487c80bf46808d440ad6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.109434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-671c6708-50f9-43fb-af55-8dcced8f0629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8930db582843487c80bf46808d440ad6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.115016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:43.128794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1322/2631] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:36:42 2022] DELETE /identity/v3/users/8930db582843487c80bf46808d440ad6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:43.421609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:43.423080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:43.440806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80478e2a-d667-4ee8-84b0-96887e1729ea admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:43.454020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:43.508925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:43.509820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:43.510126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:43.510410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] PATH_INFO: `/v3/projects/14a127f5a88744829bc33773aeed1aee` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:43.511681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a127f5a88744829bc33773aeed1aee)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:43.513616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:43.564961 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a127f5a88744829bc33773aeed1aee', 'request_id': 'req-3b6809b6-22b5-4978-acbd-ec7d276a4a73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.570471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a127f5a88744829bc33773aeed1aee', 'request_id': 'req-3b6809b6-22b5-4978-acbd-ec7d276a4a73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.580390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a127f5a88744829bc33773aeed1aee', 'request_id': 'req-3b6809b6-22b5-4978-acbd-ec7d276a4a73'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.595521 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] The token cache is being invalidate because project 14a127f5a88744829bc33773aeed1aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:36:43.595809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.596466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3b6809b6-22b5-4978-acbd-ec7d276a4a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:43.598048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1310/2632] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:36:43 2022] DELETE /identity/v3/projects/14a127f5a88744829bc33773aeed1aee => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:43.604634 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d304a7-d128-4d5b-bdec-d63a3cc68f47 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:43.605241 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d304a7-d128-4d5b-bdec-d63a3cc68f47 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:43.605554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d304a7-d128-4d5b-bdec-d63a3cc68f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:43.625158 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b9d304a7-d128-4d5b-bdec-d63a3cc68f47 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:43.626468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b9d304a7-d128-4d5b-bdec-d63a3cc68f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:43.687752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1323/2633] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:43.696767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b22bb-fef8-4907-85ba-fc4f2b9186de None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:43.697058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b22bb-fef8-4907-85ba-fc4f2b9186de None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:43.697359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b22bb-fef8-4907-85ba-fc4f2b9186de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:43.717020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5e1b22bb-fef8-4907-85ba-fc4f2b9186de None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:43.718254 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5e1b22bb-fef8-4907-85ba-fc4f2b9186de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:43.728432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1311/2634] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:43.733853 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d304a7-d128-4d5b-bdec-d63a3cc68f47 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:43.747483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d304a7-d128-4d5b-bdec-d63a3cc68f47 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:43.753714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4853f2-0c83-4952-80e4-e94b64cd8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:43.753980 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4853f2-0c83-4952-80e4-e94b64cd8bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:43.754299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4853f2-0c83-4952-80e4-e94b64cd8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:43.754584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4853f2-0c83-4952-80e4-e94b64cd8bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:43.755306 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4853f2-0c83-4952-80e4-e94b64cd8bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:36:43.755618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4853f2-0c83-4952-80e4-e94b64cd8bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:43.757814 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4853f2-0c83-4952-80e4-e94b64cd8bf1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:43.770190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1324/2635] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:36:43.775244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b22bb-fef8-4907-85ba-fc4f2b9186de None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:43.784909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b22bb-fef8-4907-85ba-fc4f2b9186de None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:43.791052 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daf6a1-aada-4596-ae8b-dc13b61c61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:43.791730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daf6a1-aada-4596-ae8b-dc13b61c61ba admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:43.792058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daf6a1-aada-4596-ae8b-dc13b61c61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:43.792269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daf6a1-aada-4596-ae8b-dc13b61c61ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:43.793014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07daf6a1-aada-4596-ae8b-dc13b61c61ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:43.795045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07daf6a1-aada-4596-ae8b-dc13b61c61ba admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:43.823551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1312/2636] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:36:43 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:43.829175 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4853f2-0c83-4952-80e4-e94b64cd8bf1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:43.839469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4853f2-0c83-4952-80e4-e94b64cd8bf1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:43.900045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedc5bf-9aa1-402b-8ac1-327dd6aeb4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:43.900642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedc5bf-9aa1-402b-8ac1-327dd6aeb4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:43.900932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedc5bf-9aa1-402b-8ac1-327dd6aeb4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:43.901207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedc5bf-9aa1-402b-8ac1-327dd6aeb4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:43.901907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedc5bf-9aa1-402b-8ac1-327dd6aeb4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:43.903953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedc5bf-9aa1-402b-8ac1-327dd6aeb4d6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:43.926816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1325/2637] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:36:43 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:36:43.933073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daf6a1-aada-4596-ae8b-dc13b61c61ba admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:43.943554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daf6a1-aada-4596-ae8b-dc13b61c61ba admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:43.949151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe580b-f3c4-43bf-b897-7c217efda711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:43.949816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe580b-f3c4-43bf-b897-7c217efda711 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:43.950124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe580b-f3c4-43bf-b897-7c217efda711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:43.950438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe580b-f3c4-43bf-b897-7c217efda711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:43.951174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe580b-f3c4-43bf-b897-7c217efda711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:43.952802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe580b-f3c4-43bf-b897-7c217efda711 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:43.964485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1313/2638] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:43.968712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedc5bf-9aa1-402b-8ac1-327dd6aeb4d6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:43.979143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedc5bf-9aa1-402b-8ac1-327dd6aeb4d6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:43.984663 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1755354-a9da-4cd9-863d-c0af390eb715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:43.985326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1755354-a9da-4cd9-863d-c0af390eb715 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:43.985578 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1755354-a9da-4cd9-863d-c0af390eb715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:43.985890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1755354-a9da-4cd9-863d-c0af390eb715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:43.986645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1755354-a9da-4cd9-863d-c0af390eb715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:43.988295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1755354-a9da-4cd9-863d-c0af390eb715 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:43.998645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1326/2639] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:44.002833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe580b-f3c4-43bf-b897-7c217efda711 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:44.013920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe580b-f3c4-43bf-b897-7c217efda711 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:44.019809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430baa2-3814-4384-b3a8-5970d6fd95d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:44.020782 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430baa2-3814-4384-b3a8-5970d6fd95d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:44.021070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430baa2-3814-4384-b3a8-5970d6fd95d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:44.021349 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430baa2-3814-4384-b3a8-5970d6fd95d7 admin admin] PATH_INFO: `/v3/projects/7de376eed26944cc8de259af0d1c7a57/users/6f2c9d73bd1948309fa3d09458afd6f6/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:44.038434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430baa2-3814-4384-b3a8-5970d6fd95d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de376eed26944cc8de259af0d1c7a57, user_id=6f2c9d73bd1948309fa3d09458afd6f6, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:44.041154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430baa2-3814-4384-b3a8-5970d6fd95d7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:44.057137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1314/2640] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:36:44 2022] PUT /identity/v3/projects/7de376eed26944cc8de259af0d1c7a57/users/6f2c9d73bd1948309fa3d09458afd6f6/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:44.067439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b7f07-a701-4142-94c9-91fb0b821c2c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:44.067765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b7f07-a701-4142-94c9-91fb0b821c2c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:44.068045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b7f07-a701-4142-94c9-91fb0b821c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:44.095235 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b25b7f07-a701-4142-94c9-91fb0b821c2c None None] MFA Rules not processed for user `6f2c9d73bd1948309fa3d09458afd6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:44.096467 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b25b7f07-a701-4142-94c9-91fb0b821c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:44.141963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:44.167017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1327/2641] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:44.178452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430baa2-3814-4384-b3a8-5970d6fd95d7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:44.180509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1430baa2-3814-4384-b3a8-5970d6fd95d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:44.228317 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:44.242602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430baa2-3814-4384-b3a8-5970d6fd95d7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:44.246670 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89c11a-4406-46ac-b619-968e01c76373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:44.247320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89c11a-4406-46ac-b619-968e01c76373 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:44.247600 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89c11a-4406-46ac-b619-968e01c76373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:44.247873 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89c11a-4406-46ac-b619-968e01c76373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:44.256342 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89c11a-4406-46ac-b619-968e01c76373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:44.257788 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89c11a-4406-46ac-b619-968e01c76373 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:44.266498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1315/2642] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:44.285829 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b7f07-a701-4142-94c9-91fb0b821c2c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:44.349955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b7f07-a701-4142-94c9-91fb0b821c2c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:44.355653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:44.356546 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:44.356839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:44.357103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] PATH_INFO: `/v3/users/6f2c9d73bd1948309fa3d09458afd6f6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:44.358369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2c9d73bd1948309fa3d09458afd6f6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:44.360334 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:44.410430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2c9d73bd1948309fa3d09458afd6f6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:44.411098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2c9d73bd1948309fa3d09458afd6f6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:44.411730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2c9d73bd1948309fa3d09458afd6f6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:44.419022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2c9d73bd1948309fa3d09458afd6f6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:44.428000 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2c9d73bd1948309fa3d09458afd6f6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:44.445293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1328/2643] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:36:44 2022] DELETE /identity/v3/users/6f2c9d73bd1948309fa3d09458afd6f6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:44.450011 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba002eef-40af-42f3-934f-b4a2067808bb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:44.450335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba002eef-40af-42f3-934f-b4a2067808bb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:44.450618 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba002eef-40af-42f3-934f-b4a2067808bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:44.469392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ba002eef-40af-42f3-934f-b4a2067808bb None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:44.470631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ba002eef-40af-42f3-934f-b4a2067808bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:44.542368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1316/2644] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:44.552310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:44.554193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:44.612595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4b2e4-2380-42f6-baf2-64a3ec71c4fc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:44.616765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a4d0d-1b2d-4d2b-b71e-bd3f5fae1648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:44.617410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4d0d-1b2d-4d2b-b71e-bd3f5fae1648 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:44.617695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4d0d-1b2d-4d2b-b71e-bd3f5fae1648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:44.617983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a4d0d-1b2d-4d2b-b71e-bd3f5fae1648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:44.627561 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a4d0d-1b2d-4d2b-b71e-bd3f5fae1648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:44.629016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a4d0d-1b2d-4d2b-b71e-bd3f5fae1648 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:44.638801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1329/2645] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:44.914880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba002eef-40af-42f3-934f-b4a2067808bb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:44.916506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ba002eef-40af-42f3-934f-b4a2067808bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:44.929069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba002eef-40af-42f3-934f-b4a2067808bb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:44.934531 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:44.935432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:44.935710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:44.935987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] PATH_INFO: `/v3/projects/7de376eed26944cc8de259af0d1c7a57` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:44.937301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de376eed26944cc8de259af0d1c7a57)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:44.939366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:44.998764 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de376eed26944cc8de259af0d1c7a57', 'request_id': 'req-5055c440-d237-41ca-b4f3-4c5cb875d51b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:45.005233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de376eed26944cc8de259af0d1c7a57', 'request_id': 'req-5055c440-d237-41ca-b4f3-4c5cb875d51b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:45.011484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de376eed26944cc8de259af0d1c7a57', 'request_id': 'req-5055c440-d237-41ca-b4f3-4c5cb875d51b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:45.026314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] The token cache is being invalidate because project 7de376eed26944cc8de259af0d1c7a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:36:45.026601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:45.027236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5055c440-d237-41ca-b4f3-4c5cb875d51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:36:45.028807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1317/2646] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:36:44 2022] DELETE /identity/v3/projects/7de376eed26944cc8de259af0d1c7a57 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:45.033752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d603913-0dc2-4321-9dea-208ba1f6388b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.034279 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d603913-0dc2-4321-9dea-208ba1f6388b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.034407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d603913-0dc2-4321-9dea-208ba1f6388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.042352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:45.055434 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1d603913-0dc2-4321-9dea-208ba1f6388b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:45.056820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1d603913-0dc2-4321-9dea-208ba1f6388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:45.127524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1330/2647] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:45.135544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19857a8-ef1b-4707-99f5-ef7682e401dd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.135852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19857a8-ef1b-4707-99f5-ef7682e401dd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.136160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19857a8-ef1b-4707-99f5-ef7682e401dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.154675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b19857a8-ef1b-4707-99f5-ef7682e401dd None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:45.155869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b19857a8-ef1b-4707-99f5-ef7682e401dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:45.164131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1318/2648] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:45.168431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d603913-0dc2-4321-9dea-208ba1f6388b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:45.180942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d603913-0dc2-4321-9dea-208ba1f6388b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:45.187290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a161ae0-d878-4fb7-96b4-2e2627fe0966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:45.187955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a161ae0-d878-4fb7-96b4-2e2627fe0966 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.188238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a161ae0-d878-4fb7-96b4-2e2627fe0966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.188534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a161ae0-d878-4fb7-96b4-2e2627fe0966 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.189234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a161ae0-d878-4fb7-96b4-2e2627fe0966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:36:45.189570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a161ae0-d878-4fb7-96b4-2e2627fe0966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:45.191219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a161ae0-d878-4fb7-96b4-2e2627fe0966 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:45.203317 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1331/2649] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:36:45.207554 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19857a8-ef1b-4707-99f5-ef7682e401dd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:45.216960 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19857a8-ef1b-4707-99f5-ef7682e401dd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:45.222386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feee1dd-7c13-4b7e-bdcf-9f33c508a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:45.223041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feee1dd-7c13-4b7e-bdcf-9f33c508a9ec admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.223331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feee1dd-7c13-4b7e-bdcf-9f33c508a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.223619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feee1dd-7c13-4b7e-bdcf-9f33c508a9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.224306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feee1dd-7c13-4b7e-bdcf-9f33c508a9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:45.226479 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feee1dd-7c13-4b7e-bdcf-9f33c508a9ec admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:45.255126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1319/2650] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:36:45 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:45.259333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a161ae0-d878-4fb7-96b4-2e2627fe0966 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:45.269792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a161ae0-d878-4fb7-96b4-2e2627fe0966 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:45.337293 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a66af-2cf0-4b4e-b458-b460605a1e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:45.337979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a66af-2cf0-4b4e-b458-b460605a1e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.338344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a66af-2cf0-4b4e-b458-b460605a1e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.338709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a66af-2cf0-4b4e-b458-b460605a1e53 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.339751 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a66af-2cf0-4b4e-b458-b460605a1e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:45.341801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a66af-2cf0-4b4e-b458-b460605a1e53 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:45.363089 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1332/2651] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:36:45 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:36:45.368874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feee1dd-7c13-4b7e-bdcf-9f33c508a9ec admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:45.380016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feee1dd-7c13-4b7e-bdcf-9f33c508a9ec admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:45.385162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d79f24-013a-4001-b97d-4f29933beac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:45.385839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d79f24-013a-4001-b97d-4f29933beac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.386143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d79f24-013a-4001-b97d-4f29933beac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.386449 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d79f24-013a-4001-b97d-4f29933beac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.387197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d79f24-013a-4001-b97d-4f29933beac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:45.388825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d79f24-013a-4001-b97d-4f29933beac0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:45.399774 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1320/2652] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:45.403709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a66af-2cf0-4b4e-b458-b460605a1e53 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:45.414119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a66af-2cf0-4b4e-b458-b460605a1e53 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:45.419214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b850cb-26ca-4d99-95c2-f35b29d05c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:45.419881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b850cb-26ca-4d99-95c2-f35b29d05c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.420166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b850cb-26ca-4d99-95c2-f35b29d05c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.420445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b850cb-26ca-4d99-95c2-f35b29d05c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.421179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b850cb-26ca-4d99-95c2-f35b29d05c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:45.422873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b850cb-26ca-4d99-95c2-f35b29d05c2b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:45.433564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1333/2653] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:36:45.437366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d79f24-013a-4001-b97d-4f29933beac0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:45.447853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d79f24-013a-4001-b97d-4f29933beac0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:45.452971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c715b5-89fc-4dc1-aeb7-b37310ffc637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:45.453862 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c715b5-89fc-4dc1-aeb7-b37310ffc637 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.454201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c715b5-89fc-4dc1-aeb7-b37310ffc637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.454484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c715b5-89fc-4dc1-aeb7-b37310ffc637 admin admin] PATH_INFO: `/v3/projects/0913f851ff164415a466c466de1ece6e/users/0a3da974f5be44e2946fc0d3b9423d9d/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.470390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c715b5-89fc-4dc1-aeb7-b37310ffc637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0913f851ff164415a466c466de1ece6e, user_id=0a3da974f5be44e2946fc0d3b9423d9d, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:45.473112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c715b5-89fc-4dc1-aeb7-b37310ffc637 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:45.490638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1321/2654] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:36:45 2022] PUT /identity/v3/projects/0913f851ff164415a466c466de1ece6e/users/0a3da974f5be44e2946fc0d3b9423d9d/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:36:45.498023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a9c6-45c2-4dea-8109-b56bacc158ac None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.498345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a9c6-45c2-4dea-8109-b56bacc158ac None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.498618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a9c6-45c2-4dea-8109-b56bacc158ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.517147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b477a9c6-45c2-4dea-8109-b56bacc158ac None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:45.518308 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b477a9c6-45c2-4dea-8109-b56bacc158ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:45.594459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1334/2655] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:45.604751 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c715b5-89fc-4dc1-aeb7-b37310ffc637 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:45.607185 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-95c715b5-89fc-4dc1-aeb7-b37310ffc637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:45.614532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:45.670178 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c715b5-89fc-4dc1-aeb7-b37310ffc637 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:45.674527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091af8-55e2-4372-93a8-33b2700d173f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:45.675190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091af8-55e2-4372-93a8-33b2700d173f service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:45.675477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091af8-55e2-4372-93a8-33b2700d173f service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:45.675760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091af8-55e2-4372-93a8-33b2700d173f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:45.686063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091af8-55e2-4372-93a8-33b2700d173f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:45.687550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091af8-55e2-4372-93a8-33b2700d173f service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:45.697929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1322/2656] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:46.346058 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96746-a864-4e88-8ffb-4fdeead3b848 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:46.346691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96746-a864-4e88-8ffb-4fdeead3b848 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:46.346691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96746-a864-4e88-8ffb-4fdeead3b848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:46.367368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:36:46.384206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b3b96746-a864-4e88-8ffb-4fdeead3b848 None None] MFA Rules not processed for user `0a3da974f5be44e2946fc0d3b9423d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:46.385569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b3b96746-a864-4e88-8ffb-4fdeead3b848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:46.456911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1335/2657] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:46.467840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091af8-55e2-4372-93a8-33b2700d173f service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:46.469383 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e091af8-55e2-4372-93a8-33b2700d173f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:46.526402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091af8-55e2-4372-93a8-33b2700d173f service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:46.530279 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93740142-6c86-4c40-96ac-887a74aa04fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:46.530943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93740142-6c86-4c40-96ac-887a74aa04fb service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:46.531227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93740142-6c86-4c40-96ac-887a74aa04fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:46.531504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93740142-6c86-4c40-96ac-887a74aa04fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:46.540320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93740142-6c86-4c40-96ac-887a74aa04fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:46.541807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93740142-6c86-4c40-96ac-887a74aa04fb service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:46.550531 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1323/2658] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:47.915652 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868b162-d24f-478f-88e3-1d0b6f953519 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:47.916152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868b162-d24f-478f-88e3-1d0b6f953519 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:47.916263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868b162-d24f-478f-88e3-1d0b6f953519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:47.938254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2868b162-d24f-478f-88e3-1d0b6f953519 None None] MFA Rules not processed for user `0a3da974f5be44e2946fc0d3b9423d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:36:47.940062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2868b162-d24f-478f-88e3-1d0b6f953519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:47.952688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1336/2659] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:36:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:36:48.209215 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93740142-6c86-4c40-96ac-887a74aa04fb service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:48.218860 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93740142-6c86-4c40-96ac-887a74aa04fb service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:48.223452 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:48.224118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:48.224391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:48.224663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:48.227072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:48.238008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:48.239487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:48.253513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1324/2660] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:49.625588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868b162-d24f-478f-88e3-1d0b6f953519 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:49.627804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2868b162-d24f-478f-88e3-1d0b6f953519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:49.710732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868b162-d24f-478f-88e3-1d0b6f953519 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:49.716852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:49.717676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:49.717973 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:49.718287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:49.720354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:49.733646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:49.735350 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:49.746277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1337/2661] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:55.125639 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:36:55.127250 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:55.237525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de2df-9eb0-4000-a6da-6028ba6ec523 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:36:55.243829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:36:55.244547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:36:55.244946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:36:55.245319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:36:55.247286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:36:55.260477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:36:55.262233 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:36:55.273940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1325/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:36:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:36:59.741563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=62 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:05.057579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:05.059504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:05.072245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126fd93-8d7e-4376-baec-3a0c12991756 service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:05.076218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c3f07-69ca-4002-b0ca-7b8ec8c71dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:05.076886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c3f07-69ca-4002-b0ca-7b8ec8c71dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:05.077173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c3f07-69ca-4002-b0ca-7b8ec8c71dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:05.077446 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c3f07-69ca-4002-b0ca-7b8ec8c71dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:05.079367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-191c3f07-69ca-4002-b0ca-7b8ec8c71dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:05.092627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c3f07-69ca-4002-b0ca-7b8ec8c71dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:05.094136 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c3f07-69ca-4002-b0ca-7b8ec8c71dc8 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:05.105489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1338/2663] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:05.269278 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:08.784524 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:08.786161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:08.801551 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e729add-ec02-4801-9ede-956277b6c1c5 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:08.806560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:08.807534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:08.807800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:08.808075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] PATH_INFO: `/v3/users/847c39439e874e68b72e07c311a53bec` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:08.809287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] RBAC: Authorizing `identity:delete_user(user_id=847c39439e874e68b72e07c311a53bec)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:08.811280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:08.860472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847c39439e874e68b72e07c311a53bec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:08.877907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847c39439e874e68b72e07c311a53bec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:08.879291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847c39439e874e68b72e07c311a53bec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:08.887740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847c39439e874e68b72e07c311a53bec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:08.895829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847c39439e874e68b72e07c311a53bec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:08.901269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1326/2664] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:37:08 2022] DELETE /identity/v3/users/847c39439e874e68b72e07c311a53bec => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:08.913342 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6fb6e-494a-4516-be33-812c27fa05cc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:08.913862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6fb6e-494a-4516-be33-812c27fa05cc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:08.913959 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6fb6e-494a-4516-be33-812c27fa05cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:08.932490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0ab6fb6e-494a-4516-be33-812c27fa05cc None None] MFA Rules not processed for user `0a3da974f5be44e2946fc0d3b9423d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:08.934018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0ab6fb6e-494a-4516-be33-812c27fa05cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:08.993278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1339/2665] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:09.092147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:09.094067 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:09.180533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56107bd7-363d-459f-9708-cb9cd7dc265c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:09.185285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:09.186206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.186493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.186777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] PATH_INFO: `/v3/projects/c777f8f104af4d37a3b89ff9a57d2218` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.188009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c777f8f104af4d37a3b89ff9a57d2218)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:09.189973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:09.240261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c777f8f104af4d37a3b89ff9a57d2218', 'request_id': 'req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:09.246290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c777f8f104af4d37a3b89ff9a57d2218', 'request_id': 'req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:09.261587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c777f8f104af4d37a3b89ff9a57d2218', 'request_id': 'req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:09.274660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] The token cache is being invalidate because project c777f8f104af4d37a3b89ff9a57d2218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:37:09.274958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:09.275582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc2c0d0c-307e-4a5b-b12e-6186463c1cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:09.277146 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1327/2666] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:37:09 2022] DELETE /identity/v3/projects/c777f8f104af4d37a3b89ff9a57d2218 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:09.282316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d2e2a-6f3c-4e89-be39-8b39e8e48426 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.282613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d2e2a-6f3c-4e89-be39-8b39e8e48426 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.282899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d2e2a-6f3c-4e89-be39-8b39e8e48426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.301598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f14d2e2a-6f3c-4e89-be39-8b39e8e48426 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:09.302883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f14d2e2a-6f3c-4e89-be39-8b39e8e48426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:09.366443 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1340/2667] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:37:09.375060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbd865-049e-4960-b20b-28a42c329c1a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.375350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbd865-049e-4960-b20b-28a42c329c1a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.375633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbd865-049e-4960-b20b-28a42c329c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.382052 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:09.396931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-38bbd865-049e-4960-b20b-28a42c329c1a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:09.398171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-38bbd865-049e-4960-b20b-28a42c329c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:09.406260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1328/2668] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:09.410656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d2e2a-6f3c-4e89-be39-8b39e8e48426 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:09.421969 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d2e2a-6f3c-4e89-be39-8b39e8e48426 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:09.426805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6a00a-9c3f-499e-9bed-746ef1f89e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:09.427550 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6a00a-9c3f-499e-9bed-746ef1f89e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.428099 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6a00a-9c3f-499e-9bed-746ef1f89e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.428477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6a00a-9c3f-499e-9bed-746ef1f89e98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.429211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6a00a-9c3f-499e-9bed-746ef1f89e98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:37:09.429526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6a00a-9c3f-499e-9bed-746ef1f89e98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:09.431244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6a00a-9c3f-499e-9bed-746ef1f89e98 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:09.460918 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1341/2669] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:37:09.466480 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbd865-049e-4960-b20b-28a42c329c1a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:09.477836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbd865-049e-4960-b20b-28a42c329c1a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:09.484057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de35d3-de23-4dce-838a-2d4141b92b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:09.484800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de35d3-de23-4dce-838a-2d4141b92b64 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.485143 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de35d3-de23-4dce-838a-2d4141b92b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.485394 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de35d3-de23-4dce-838a-2d4141b92b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.486208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de35d3-de23-4dce-838a-2d4141b92b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:09.488444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de35d3-de23-4dce-838a-2d4141b92b64 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:09.515239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1329/2670] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:37:09 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:09.522152 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6a00a-9c3f-499e-9bed-746ef1f89e98 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:09.529715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6a00a-9c3f-499e-9bed-746ef1f89e98 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:09.592436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2aa74-8247-44b3-97c3-e46efac80dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:09.593128 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2aa74-8247-44b3-97c3-e46efac80dac admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.593415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2aa74-8247-44b3-97c3-e46efac80dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.593899 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2aa74-8247-44b3-97c3-e46efac80dac admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.594646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2aa74-8247-44b3-97c3-e46efac80dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:09.597453 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2aa74-8247-44b3-97c3-e46efac80dac admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:09.623978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1342/2671] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:37:09 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:37:09.625067 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de35d3-de23-4dce-838a-2d4141b92b64 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:09.635518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de35d3-de23-4dce-838a-2d4141b92b64 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:09.640091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd92a9a-50b6-4f64-87d5-4d9313021a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:09.640767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd92a9a-50b6-4f64-87d5-4d9313021a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.641047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd92a9a-50b6-4f64-87d5-4d9313021a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.641370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd92a9a-50b6-4f64-87d5-4d9313021a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.642180 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd92a9a-50b6-4f64-87d5-4d9313021a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:09.643714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd92a9a-50b6-4f64-87d5-4d9313021a61 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:09.658367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1330/2672] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 13:37:09.659341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2aa74-8247-44b3-97c3-e46efac80dac admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:09.669800 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2aa74-8247-44b3-97c3-e46efac80dac admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:09.674676 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cec6f-a4c2-4418-9870-f6e5f9fc2e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:09.676005 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cec6f-a4c2-4418-9870-f6e5f9fc2e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.676291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cec6f-a4c2-4418-9870-f6e5f9fc2e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.676570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cec6f-a4c2-4418-9870-f6e5f9fc2e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.677310 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cec6f-a4c2-4418-9870-f6e5f9fc2e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:09.679660 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cec6f-a4c2-4418-9870-f6e5f9fc2e48 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:09.682216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:09.692709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1343/2673] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:09.697099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd92a9a-50b6-4f64-87d5-4d9313021a61 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:09.707717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd92a9a-50b6-4f64-87d5-4d9313021a61 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:09.713369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91299cca-ce73-4940-b542-a56e4e18d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:09.714310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91299cca-ce73-4940-b542-a56e4e18d83c admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.714603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91299cca-ce73-4940-b542-a56e4e18d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.714883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91299cca-ce73-4940-b542-a56e4e18d83c admin admin] PATH_INFO: `/v3/projects/06703c9a670c424288ee70e9f1d1b1af/users/50129e244b1f47cc8f9b19d4c8d3c41d/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.731677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91299cca-ce73-4940-b542-a56e4e18d83c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06703c9a670c424288ee70e9f1d1b1af, user_id=50129e244b1f47cc8f9b19d4c8d3c41d, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:09.734414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91299cca-ce73-4940-b542-a56e4e18d83c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:09.750174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1331/2674] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:09 2022] PUT /identity/v3/projects/06703c9a670c424288ee70e9f1d1b1af/users/50129e244b1f47cc8f9b19d4c8d3c41d/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:09.766557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb44a2-5799-4867-aa0e-598f752314b1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.767054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb44a2-5799-4867-aa0e-598f752314b1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.767490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb44a2-5799-4867-aa0e-598f752314b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.801976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a8cb44a2-5799-4867-aa0e-598f752314b1 None None] MFA Rules not processed for user `50129e244b1f47cc8f9b19d4c8d3c41d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:09.804177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a8cb44a2-5799-4867-aa0e-598f752314b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:09.873110 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1344/2675] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:09.877940 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91299cca-ce73-4940-b542-a56e4e18d83c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:09.944125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91299cca-ce73-4940-b542-a56e4e18d83c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:09.948840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b19379-df0e-4967-b12e-a35cb621ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:09.949498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b19379-df0e-4967-b12e-a35cb621ed3a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:09.949785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b19379-df0e-4967-b12e-a35cb621ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:09.950065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b19379-df0e-4967-b12e-a35cb621ed3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:09.950791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b19379-df0e-4967-b12e-a35cb621ed3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:09.952734 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b19379-df0e-4967-b12e-a35cb621ed3a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:09.980470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1332/2676] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:37:09 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:37:09.984359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb44a2-5799-4867-aa0e-598f752314b1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:09.996526 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb44a2-5799-4867-aa0e-598f752314b1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:10.058448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c81db-aa20-421b-8705-a55a624091e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:10.059143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c81db-aa20-421b-8705-a55a624091e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:10.059428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c81db-aa20-421b-8705-a55a624091e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:10.059709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c81db-aa20-421b-8705-a55a624091e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:10.060428 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c81db-aa20-421b-8705-a55a624091e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:10.062473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c81db-aa20-421b-8705-a55a624091e1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:10.084607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1345/2677] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:37:09 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:10.088818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b19379-df0e-4967-b12e-a35cb621ed3a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:10.106510 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b19379-df0e-4967-b12e-a35cb621ed3a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:10.111731 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db99f6-2b91-479c-ba61-1f4edbdeb25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:10.112425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db99f6-2b91-479c-ba61-1f4edbdeb25e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:10.112711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db99f6-2b91-479c-ba61-1f4edbdeb25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:10.112990 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db99f6-2b91-479c-ba61-1f4edbdeb25e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:10.113751 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db99f6-2b91-479c-ba61-1f4edbdeb25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:10.115684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db99f6-2b91-479c-ba61-1f4edbdeb25e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:10.127825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1333/2678] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:10.132198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c81db-aa20-421b-8705-a55a624091e1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:10.147536 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c81db-aa20-421b-8705-a55a624091e1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:10.152775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942615-dfb5-43c7-afeb-b3abf7a0f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:10.153718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942615-dfb5-43c7-afeb-b3abf7a0f21a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:10.154013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942615-dfb5-43c7-afeb-b3abf7a0f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:10.154400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942615-dfb5-43c7-afeb-b3abf7a0f21a admin admin] PATH_INFO: `/v3/projects/fc75261f1c79485c88428f36122e6316/users/5e007e443e8c4575b9859b60cf1033a3/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:10.171080 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0942615-dfb5-43c7-afeb-b3abf7a0f21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc75261f1c79485c88428f36122e6316, user_id=5e007e443e8c4575b9859b60cf1033a3, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:10.173807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0942615-dfb5-43c7-afeb-b3abf7a0f21a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:10.187186 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1346/2679] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:10 2022] PUT /identity/v3/projects/fc75261f1c79485c88428f36122e6316/users/5e007e443e8c4575b9859b60cf1033a3/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:37:10.191264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db99f6-2b91-479c-ba61-1f4edbdeb25e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:10.201457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db99f6-2b91-479c-ba61-1f4edbdeb25e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:10.261370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea71281-4e14-4170-8ef9-ed8d8778a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:10.261976 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea71281-4e14-4170-8ef9-ed8d8778a1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:10.262291 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea71281-4e14-4170-8ef9-ed8d8778a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:10.262572 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea71281-4e14-4170-8ef9-ed8d8778a1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:10.263298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea71281-4e14-4170-8ef9-ed8d8778a1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:10.264926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea71281-4e14-4170-8ef9-ed8d8778a1e5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:10.275839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1334/2680] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 13:37:10.280103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942615-dfb5-43c7-afeb-b3abf7a0f21a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:10.292203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942615-dfb5-43c7-afeb-b3abf7a0f21a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:10.298992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e459ac-52ec-44b6-ba4c-2f32c4fb3257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:10.299841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e459ac-52ec-44b6-ba4c-2f32c4fb3257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:10.300160 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e459ac-52ec-44b6-ba4c-2f32c4fb3257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:10.300517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e459ac-52ec-44b6-ba4c-2f32c4fb3257 admin admin] PATH_INFO: `/v3/projects/fc75261f1c79485c88428f36122e6316/users/5e007e443e8c4575b9859b60cf1033a3/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:10.302739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e459ac-52ec-44b6-ba4c-2f32c4fb3257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc75261f1c79485c88428f36122e6316, user_id=5e007e443e8c4575b9859b60cf1033a3, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:10.306199 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e459ac-52ec-44b6-ba4c-2f32c4fb3257 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:10.319760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1347/2681] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:10 2022] PUT /identity/v3/projects/fc75261f1c79485c88428f36122e6316/users/5e007e443e8c4575b9859b60cf1033a3/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:10.330122 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb80d5-f2df-42be-b829-6a7d34c466f9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:10.330434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb80d5-f2df-42be-b829-6a7d34c466f9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:10.330682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb80d5-f2df-42be-b829-6a7d34c466f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:10.352968 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:10.363762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-51bb80d5-f2df-42be-b829-6a7d34c466f9 None None] MFA Rules not processed for user `5e007e443e8c4575b9859b60cf1033a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:10.364997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-51bb80d5-f2df-42be-b829-6a7d34c466f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:10.446754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1335/2682] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:10.459461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e459ac-52ec-44b6-ba4c-2f32c4fb3257 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:10.461302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-42e459ac-52ec-44b6-ba4c-2f32c4fb3257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:10.508495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:10.526533 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e459ac-52ec-44b6-ba4c-2f32c4fb3257 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:10.530320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b2cc4-e1d2-49eb-b000-856e5c2347f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:10.530983 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b2cc4-e1d2-49eb-b000-856e5c2347f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:10.531265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b2cc4-e1d2-49eb-b000-856e5c2347f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:10.531535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b2cc4-e1d2-49eb-b000-856e5c2347f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:10.541881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b2cc4-e1d2-49eb-b000-856e5c2347f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:10.543755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b2cc4-e1d2-49eb-b000-856e5c2347f5 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:10.556112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1348/2683] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:10.982195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb80d5-f2df-42be-b829-6a7d34c466f9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:11.051260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb80d5-f2df-42be-b829-6a7d34c466f9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:11.055799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:11.056709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:11.056989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:11.057268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] PATH_INFO: `/v3/users/50129e244b1f47cc8f9b19d4c8d3c41d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:11.058499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50129e244b1f47cc8f9b19d4c8d3c41d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:11.060465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:11.111625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50129e244b1f47cc8f9b19d4c8d3c41d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.124235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50129e244b1f47cc8f9b19d4c8d3c41d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.124927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50129e244b1f47cc8f9b19d4c8d3c41d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.134014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50129e244b1f47cc8f9b19d4c8d3c41d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.142051 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50129e244b1f47cc8f9b19d4c8d3c41d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.150518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1336/2684] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:37:10 2022] DELETE /identity/v3/users/50129e244b1f47cc8f9b19d4c8d3c41d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:37:11.155038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fba66-f4fe-4e3c-97b2-cf20fa9345a6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:11.155701 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fba66-f4fe-4e3c-97b2-cf20fa9345a6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:11.155996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fba66-f4fe-4e3c-97b2-cf20fa9345a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:11.179321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9b1fba66-f4fe-4e3c-97b2-cf20fa9345a6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:11.180668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9b1fba66-f4fe-4e3c-97b2-cf20fa9345a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:11.242401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1349/2685] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:11.251843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:11.253509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:11.273773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:11.317620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf68ab-5f24-41c2-81c6-29f566f29620 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:11.321858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da4ad-37bc-445a-8f81-9536046253e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:11.322564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da4ad-37bc-445a-8f81-9536046253e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:11.322853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da4ad-37bc-445a-8f81-9536046253e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:11.323136 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da4ad-37bc-445a-8f81-9536046253e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:11.332982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03da4ad-37bc-445a-8f81-9536046253e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:11.334762 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03da4ad-37bc-445a-8f81-9536046253e0 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:11.345163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1337/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:11.848916 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fba66-f4fe-4e3c-97b2-cf20fa9345a6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:11.850492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9b1fba66-f4fe-4e3c-97b2-cf20fa9345a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:11.863116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fba66-f4fe-4e3c-97b2-cf20fa9345a6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:11.870043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:11.870996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:11.871321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:11.871560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] PATH_INFO: `/v3/projects/06703c9a670c424288ee70e9f1d1b1af` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:11.873455 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06703c9a670c424288ee70e9f1d1b1af)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:11.876242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:11.937234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06703c9a670c424288ee70e9f1d1b1af', 'request_id': 'req-4a0ad408-7654-4caa-8c36-f0bb79671e00'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.943737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06703c9a670c424288ee70e9f1d1b1af', 'request_id': 'req-4a0ad408-7654-4caa-8c36-f0bb79671e00'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.952157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06703c9a670c424288ee70e9f1d1b1af', 'request_id': 'req-4a0ad408-7654-4caa-8c36-f0bb79671e00'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.963786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] The token cache is being invalidate because project 06703c9a670c424288ee70e9f1d1b1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:37:11.964249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.965205 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:11.966682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1350/2687] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:37:11 2022] DELETE /identity/v3/projects/06703c9a670c424288ee70e9f1d1b1af => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:11.970842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da4ad-37bc-445a-8f81-9536046253e0 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:11.980896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da4ad-37bc-445a-8f81-9536046253e0 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:12.052103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:12.053299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:12.053799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:12.053799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] PATH_INFO: `/v3/users/5e007e443e8c4575b9859b60cf1033a3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:12.055125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e007e443e8c4575b9859b60cf1033a3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:12.057138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:12.102942 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e007e443e8c4575b9859b60cf1033a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.115936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e007e443e8c4575b9859b60cf1033a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.116677 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e007e443e8c4575b9859b60cf1033a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.125552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e007e443e8c4575b9859b60cf1033a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.133652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-adc32835-f35d-4fa7-a2cc-24debc7e6cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e007e443e8c4575b9859b60cf1033a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.140389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1338/2688] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:37:11 2022] DELETE /identity/v3/users/5e007e443e8c4575b9859b60cf1033a3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:12.432146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:12.433650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:12.452239 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad408-7654-4caa-8c36-f0bb79671e00 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:12.512451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:12.513626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:12.513890 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:12.514316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] PATH_INFO: `/v3/projects/fc75261f1c79485c88428f36122e6316` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:12.516246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc75261f1c79485c88428f36122e6316)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:12.518902 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:12.528103 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:12.571074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc75261f1c79485c88428f36122e6316', 'request_id': 'req-5c8be7c5-0d5c-490a-a790-35dc9ab23250'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.577402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc75261f1c79485c88428f36122e6316', 'request_id': 'req-5c8be7c5-0d5c-490a-a790-35dc9ab23250'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.585988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc75261f1c79485c88428f36122e6316', 'request_id': 'req-5c8be7c5-0d5c-490a-a790-35dc9ab23250'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.596256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] The token cache is being invalidate because project fc75261f1c79485c88428f36122e6316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:37:12.596537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.597172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c8be7c5-0d5c-490a-a790-35dc9ab23250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:12.598791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1351/2689] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:37:12 2022] DELETE /identity/v3/projects/fc75261f1c79485c88428f36122e6316 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:12.605573 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a433de-3f55-4f16-b39c-edf2ef9e3633 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:12.605866 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a433de-3f55-4f16-b39c-edf2ef9e3633 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:12.606141 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a433de-3f55-4f16-b39c-edf2ef9e3633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:12.626666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e7a433de-3f55-4f16-b39c-edf2ef9e3633 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:12.627829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e7a433de-3f55-4f16-b39c-edf2ef9e3633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:12.664018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:12.696535 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1339/2690] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:12.705843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f8c19-8174-47ac-bd72-ba630a793cce None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:12.706157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f8c19-8174-47ac-bd72-ba630a793cce None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:12.706438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f8c19-8174-47ac-bd72-ba630a793cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:12.726454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-695f8c19-8174-47ac-bd72-ba630a793cce None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:12.727671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-695f8c19-8174-47ac-bd72-ba630a793cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:12.737905 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1352/2691] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:12.742377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a433de-3f55-4f16-b39c-edf2ef9e3633 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:12.752993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a433de-3f55-4f16-b39c-edf2ef9e3633 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:12.758948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448d622-cfd0-4341-9fad-8ba7336c50fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:12.759646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448d622-cfd0-4341-9fad-8ba7336c50fd admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:12.759922 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448d622-cfd0-4341-9fad-8ba7336c50fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:12.760195 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448d622-cfd0-4341-9fad-8ba7336c50fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:12.760927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448d622-cfd0-4341-9fad-8ba7336c50fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:37:12.761236 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448d622-cfd0-4341-9fad-8ba7336c50fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:12.762899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448d622-cfd0-4341-9fad-8ba7336c50fd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:12.775536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1340/2692] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:37:12.779917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f8c19-8174-47ac-bd72-ba630a793cce None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:12.789422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f8c19-8174-47ac-bd72-ba630a793cce None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:12.794770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa145f67-2435-401f-8447-6d460114d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:12.795423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa145f67-2435-401f-8447-6d460114d590 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:12.795704 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa145f67-2435-401f-8447-6d460114d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:12.795979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa145f67-2435-401f-8447-6d460114d590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:12.796702 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa145f67-2435-401f-8447-6d460114d590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:12.798765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa145f67-2435-401f-8447-6d460114d590 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:12.825359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1353/2693] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:37:12 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:12.829634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448d622-cfd0-4341-9fad-8ba7336c50fd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:12.840799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448d622-cfd0-4341-9fad-8ba7336c50fd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:12.898527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369e5c3-7266-4c90-b1fc-4324e335f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:12.899131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369e5c3-7266-4c90-b1fc-4324e335f0bc admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:12.899415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369e5c3-7266-4c90-b1fc-4324e335f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:12.899692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369e5c3-7266-4c90-b1fc-4324e335f0bc admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:12.900390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369e5c3-7266-4c90-b1fc-4324e335f0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:12.902363 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369e5c3-7266-4c90-b1fc-4324e335f0bc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:12.922504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1341/2694] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:37:12 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:12.926627 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa145f67-2435-401f-8447-6d460114d590 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:12.936794 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa145f67-2435-401f-8447-6d460114d590 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:12.941616 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8bf58-54b2-4a7c-a699-20ee1d3b99ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:12.942330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8bf58-54b2-4a7c-a699-20ee1d3b99ae admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:12.942691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8bf58-54b2-4a7c-a699-20ee1d3b99ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:12.942881 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8bf58-54b2-4a7c-a699-20ee1d3b99ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:12.944075 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8bf58-54b2-4a7c-a699-20ee1d3b99ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:12.945573 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8bf58-54b2-4a7c-a699-20ee1d3b99ae admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:12.956781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1354/2695] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:12.961045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369e5c3-7266-4c90-b1fc-4324e335f0bc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:12.971418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369e5c3-7266-4c90-b1fc-4324e335f0bc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:12.976851 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30472689-923f-4a63-b1ad-ca46cecaa2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:12.977651 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30472689-923f-4a63-b1ad-ca46cecaa2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:12.977936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30472689-923f-4a63-b1ad-ca46cecaa2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:12.978246 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30472689-923f-4a63-b1ad-ca46cecaa2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:12.978967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30472689-923f-4a63-b1ad-ca46cecaa2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:12.980891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30472689-923f-4a63-b1ad-ca46cecaa2e2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:12.992316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1342/2696] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:12.996597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8bf58-54b2-4a7c-a699-20ee1d3b99ae admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:13.007077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8bf58-54b2-4a7c-a699-20ee1d3b99ae admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:13.012291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a04bcb-1d69-4229-9cbc-c2ffcd5bf162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:13.013072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a04bcb-1d69-4229-9cbc-c2ffcd5bf162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.013352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a04bcb-1d69-4229-9cbc-c2ffcd5bf162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.013625 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a04bcb-1d69-4229-9cbc-c2ffcd5bf162 admin admin] PATH_INFO: `/v3/projects/9e3c7540c63a420386cd45d294e9a620/users/88c004de3bbb4393aea13ab03e922ac7/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.029208 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a04bcb-1d69-4229-9cbc-c2ffcd5bf162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3c7540c63a420386cd45d294e9a620, user_id=88c004de3bbb4393aea13ab03e922ac7, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:13.031928 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a04bcb-1d69-4229-9cbc-c2ffcd5bf162 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:13.046366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1355/2697] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:12 2022] PUT /identity/v3/projects/9e3c7540c63a420386cd45d294e9a620/users/88c004de3bbb4393aea13ab03e922ac7/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:13.056982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1b5d-80a8-4532-92ed-0adc7bc22f8f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.057525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1b5d-80a8-4532-92ed-0adc7bc22f8f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.057525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1b5d-80a8-4532-92ed-0adc7bc22f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.085179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9a5d1b5d-80a8-4532-92ed-0adc7bc22f8f None None] MFA Rules not processed for user `88c004de3bbb4393aea13ab03e922ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:13.086431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9a5d1b5d-80a8-4532-92ed-0adc7bc22f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:13.152864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1343/2698] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:13.158015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a04bcb-1d69-4229-9cbc-c2ffcd5bf162 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:13.221088 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a04bcb-1d69-4229-9cbc-c2ffcd5bf162 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:13.227933 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571e5ff-aaa4-46d6-9eea-988da0a4a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:13.228593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571e5ff-aaa4-46d6-9eea-988da0a4a110 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.228871 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571e5ff-aaa4-46d6-9eea-988da0a4a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.229141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571e5ff-aaa4-46d6-9eea-988da0a4a110 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.229799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571e5ff-aaa4-46d6-9eea-988da0a4a110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:13.232086 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571e5ff-aaa4-46d6-9eea-988da0a4a110 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:13.259170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1356/2699] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:37:13 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:13.263335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d1b5d-80a8-4532-92ed-0adc7bc22f8f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:13.274947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d1b5d-80a8-4532-92ed-0adc7bc22f8f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:13.305089 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:13.340821 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e8f6-11b4-4d65-96d0-5ceb57fce369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:13.341501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e8f6-11b4-4d65-96d0-5ceb57fce369 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.341784 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e8f6-11b4-4d65-96d0-5ceb57fce369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.342057 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e8f6-11b4-4d65-96d0-5ceb57fce369 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.342793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e8f6-11b4-4d65-96d0-5ceb57fce369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:13.344724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e8f6-11b4-4d65-96d0-5ceb57fce369 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:13.366002 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1344/2700] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:37:13 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:13.370223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571e5ff-aaa4-46d6-9eea-988da0a4a110 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:13.381402 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571e5ff-aaa4-46d6-9eea-988da0a4a110 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:13.387509 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080239a8-1f9d-438c-a10b-0ae6996ec0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:13.388187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080239a8-1f9d-438c-a10b-0ae6996ec0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.388471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080239a8-1f9d-438c-a10b-0ae6996ec0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.388753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080239a8-1f9d-438c-a10b-0ae6996ec0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.389469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080239a8-1f9d-438c-a10b-0ae6996ec0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:13.391157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080239a8-1f9d-438c-a10b-0ae6996ec0b6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:13.403138 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1357/2701] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:13.407420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e8f6-11b4-4d65-96d0-5ceb57fce369 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:13.417929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e8f6-11b4-4d65-96d0-5ceb57fce369 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:13.422827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c8302-54ab-4dde-b75c-566ae93f80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:13.423717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c8302-54ab-4dde-b75c-566ae93f80d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.424030 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c8302-54ab-4dde-b75c-566ae93f80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.424311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c8302-54ab-4dde-b75c-566ae93f80d7 admin admin] PATH_INFO: `/v3/projects/d839dd03e1dc468ab3afe9e6a3f679b1/users/905cb7fa7fbc48059a6a55813a431e60/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.440335 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c8302-54ab-4dde-b75c-566ae93f80d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d839dd03e1dc468ab3afe9e6a3f679b1, user_id=905cb7fa7fbc48059a6a55813a431e60, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:13.443082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c8302-54ab-4dde-b75c-566ae93f80d7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:13.458474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1345/2702] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:13 2022] PUT /identity/v3/projects/d839dd03e1dc468ab3afe9e6a3f679b1/users/905cb7fa7fbc48059a6a55813a431e60/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:13.462715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080239a8-1f9d-438c-a10b-0ae6996ec0b6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:13.473449 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080239a8-1f9d-438c-a10b-0ae6996ec0b6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:13.477558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:13.541441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2906f9-1222-441b-bc38-68fab76f1061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:13.542407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2906f9-1222-441b-bc38-68fab76f1061 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.542782 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2906f9-1222-441b-bc38-68fab76f1061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.543126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2906f9-1222-441b-bc38-68fab76f1061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.544126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2906f9-1222-441b-bc38-68fab76f1061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:13.546658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2906f9-1222-441b-bc38-68fab76f1061 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:13.558998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1358/2703] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:13.563354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c8302-54ab-4dde-b75c-566ae93f80d7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:13.574280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c8302-54ab-4dde-b75c-566ae93f80d7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:13.579194 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f12586-4228-4137-98e1-03e817f57565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:13.580103 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f12586-4228-4137-98e1-03e817f57565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.580390 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f12586-4228-4137-98e1-03e817f57565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.580704 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f12586-4228-4137-98e1-03e817f57565 admin admin] PATH_INFO: `/v3/projects/d839dd03e1dc468ab3afe9e6a3f679b1/users/905cb7fa7fbc48059a6a55813a431e60/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.582813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f12586-4228-4137-98e1-03e817f57565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d839dd03e1dc468ab3afe9e6a3f679b1, user_id=905cb7fa7fbc48059a6a55813a431e60, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:13.585813 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f12586-4228-4137-98e1-03e817f57565 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:13.597446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1346/2704] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:13 2022] PUT /identity/v3/projects/d839dd03e1dc468ab3afe9e6a3f679b1/users/905cb7fa7fbc48059a6a55813a431e60/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:13.608883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f17e78-89d5-4b1a-9c7d-ec4a2bb94779 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.609155 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f17e78-89d5-4b1a-9c7d-ec4a2bb94779 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.609469 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f17e78-89d5-4b1a-9c7d-ec4a2bb94779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.636719 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-74f17e78-89d5-4b1a-9c7d-ec4a2bb94779 None None] MFA Rules not processed for user `905cb7fa7fbc48059a6a55813a431e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:13.637931 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-74f17e78-89d5-4b1a-9c7d-ec4a2bb94779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:13.711756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1359/2705] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:13.722678 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f12586-4228-4137-98e1-03e817f57565 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:13.724711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-14f12586-4228-4137-98e1-03e817f57565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:13.788492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f12586-4228-4137-98e1-03e817f57565 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:13.792754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cee7c-3fee-437a-9fe2-c0e3f1d4f7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:13.793430 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cee7c-3fee-437a-9fe2-c0e3f1d4f7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.793724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cee7c-3fee-437a-9fe2-c0e3f1d4f7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.794004 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cee7c-3fee-437a-9fe2-c0e3f1d4f7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.804721 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cee7c-3fee-437a-9fe2-c0e3f1d4f7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:13.806209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cee7c-3fee-437a-9fe2-c0e3f1d4f7c0 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:13.816404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1347/2706] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:13.864863 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f17e78-89d5-4b1a-9c7d-ec4a2bb94779 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:13.866745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-74f17e78-89d5-4b1a-9c7d-ec4a2bb94779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:13.879714 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f17e78-89d5-4b1a-9c7d-ec4a2bb94779 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:13.884575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7484f8-943b-40b9-90e4-8e2c6d74a5b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:13.885220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7484f8-943b-40b9-90e4-8e2c6d74a5b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:13.885501 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7484f8-943b-40b9-90e4-8e2c6d74a5b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:13.885769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7484f8-943b-40b9-90e4-8e2c6d74a5b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:13.945197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7484f8-943b-40b9-90e4-8e2c6d74a5b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:13.946715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7484f8-943b-40b9-90e4-8e2c6d74a5b0 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:13.956527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1360/2707] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:17.357603 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cee7c-3fee-437a-9fe2-c0e3f1d4f7c0 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:17.421329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cee7c-3fee-437a-9fe2-c0e3f1d4f7c0 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:17.425966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:17.426887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:17.427170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:17.427451 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] PATH_INFO: `/v3/users/88c004de3bbb4393aea13ab03e922ac7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:17.428661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c004de3bbb4393aea13ab03e922ac7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:17.430663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:17.461811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:17.484358 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c004de3bbb4393aea13ab03e922ac7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:17.497596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c004de3bbb4393aea13ab03e922ac7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:17.498382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c004de3bbb4393aea13ab03e922ac7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:17.507320 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c004de3bbb4393aea13ab03e922ac7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:17.518401 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c004de3bbb4393aea13ab03e922ac7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:17.520710 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1348/2708] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:37:17 2022] DELETE /identity/v3/users/88c004de3bbb4393aea13ab03e922ac7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:17.525514 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5f367-8908-48c6-bd4f-fbe15d8edaa4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:17.525970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5f367-8908-48c6-bd4f-fbe15d8edaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:17.526115 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5f367-8908-48c6-bd4f-fbe15d8edaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:17.542994 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-75e5f367-8908-48c6-bd4f-fbe15d8edaa4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:17.544370 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-75e5f367-8908-48c6-bd4f-fbe15d8edaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:17.566652 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:17.606883 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1361/2709] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:17.619421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:17.621701 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:17.685841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2208b-38dc-4028-938b-0ad56cb2ebfa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:17.689792 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539f302-eaa8-4e72-b077-31dad09efd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:17.690496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539f302-eaa8-4e72-b077-31dad09efd5e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:17.690829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539f302-eaa8-4e72-b077-31dad09efd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:17.691105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539f302-eaa8-4e72-b077-31dad09efd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:17.702080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539f302-eaa8-4e72-b077-31dad09efd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:17.703579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539f302-eaa8-4e72-b077-31dad09efd5e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:17.713423 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1349/2710] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:37:18.008785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5f367-8908-48c6-bd4f-fbe15d8edaa4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:18.010353 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-75e5f367-8908-48c6-bd4f-fbe15d8edaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:18.026043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5f367-8908-48c6-bd4f-fbe15d8edaa4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:18.031135 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:18.031941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:18.032272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:18.032484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] PATH_INFO: `/v3/projects/9e3c7540c63a420386cd45d294e9a620` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:18.033808 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3c7540c63a420386cd45d294e9a620)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:18.035632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:18.087940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3c7540c63a420386cd45d294e9a620', 'request_id': 'req-f11430cb-bb70-4277-891a-e3ae013cafdd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.094365 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3c7540c63a420386cd45d294e9a620', 'request_id': 'req-f11430cb-bb70-4277-891a-e3ae013cafdd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.103514 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3c7540c63a420386cd45d294e9a620', 'request_id': 'req-f11430cb-bb70-4277-891a-e3ae013cafdd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.114198 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] The token cache is being invalidate because project 9e3c7540c63a420386cd45d294e9a620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:37:18.114483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.115159 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.116673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1362/2711] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:37:18 2022] DELETE /identity/v3/projects/9e3c7540c63a420386cd45d294e9a620 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:37:18.120724 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539f302-eaa8-4e72-b077-31dad09efd5e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:18.130859 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539f302-eaa8-4e72-b077-31dad09efd5e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:18.192619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:18.193582 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:18.193861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:18.194158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] PATH_INFO: `/v3/users/905cb7fa7fbc48059a6a55813a431e60` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:18.195418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=905cb7fa7fbc48059a6a55813a431e60)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:18.197354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:18.255040 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905cb7fa7fbc48059a6a55813a431e60'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.257301 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:18.277534 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905cb7fa7fbc48059a6a55813a431e60'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.278359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905cb7fa7fbc48059a6a55813a431e60'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.288637 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905cb7fa7fbc48059a6a55813a431e60'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.295768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-475a97aa-60e4-43d6-9980-f3c8beeed5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905cb7fa7fbc48059a6a55813a431e60'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.302594 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1350/2712] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:37:18 2022] DELETE /identity/v3/users/905cb7fa7fbc48059a6a55813a431e60 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:18.583834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:18.585849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:18.598737 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11430cb-bb70-4277-891a-e3ae013cafdd admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:18.672757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:18.673563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:18.673844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:18.674147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] PATH_INFO: `/v3/projects/d839dd03e1dc468ab3afe9e6a3f679b1` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:18.675368 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d839dd03e1dc468ab3afe9e6a3f679b1)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:18.677492 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:18.728219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd839dd03e1dc468ab3afe9e6a3f679b1', 'request_id': 'req-3169c185-d31e-4ce0-af83-599992d87ddb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.730558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:18.737342 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd839dd03e1dc468ab3afe9e6a3f679b1', 'request_id': 'req-3169c185-d31e-4ce0-af83-599992d87ddb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.747156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd839dd03e1dc468ab3afe9e6a3f679b1', 'request_id': 'req-3169c185-d31e-4ce0-af83-599992d87ddb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.758738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] The token cache is being invalidate because project d839dd03e1dc468ab3afe9e6a3f679b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:37:18.759141 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.759851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3169c185-d31e-4ce0-af83-599992d87ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:18.761497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1363/2713] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:37:18 2022] DELETE /identity/v3/projects/d839dd03e1dc468ab3afe9e6a3f679b1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:18.767474 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c0c1-ac49-48a1-a4b0-5789876a3875 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:18.767953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c0c1-ac49-48a1-a4b0-5789876a3875 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:18.768155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c0c1-ac49-48a1-a4b0-5789876a3875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:18.788485 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9331c0c1-ac49-48a1-a4b0-5789876a3875 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:18.789839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9331c0c1-ac49-48a1-a4b0-5789876a3875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:18.860010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1351/2714] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:18.868830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d966fde-8576-4433-be59-bd0102dad5f2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:18.869162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d966fde-8576-4433-be59-bd0102dad5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:18.869369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d966fde-8576-4433-be59-bd0102dad5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:18.892028 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3d966fde-8576-4433-be59-bd0102dad5f2 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:18.892712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3d966fde-8576-4433-be59-bd0102dad5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:18.905610 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1364/2715] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:18.907743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c0c1-ac49-48a1-a4b0-5789876a3875 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:18.919617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c0c1-ac49-48a1-a4b0-5789876a3875 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:18.925315 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ae296-ad1d-4e15-bb6f-3e5ff9d5501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:18.926021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae296-ad1d-4e15-bb6f-3e5ff9d5501a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:18.926382 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae296-ad1d-4e15-bb6f-3e5ff9d5501a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:18.927127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae296-ad1d-4e15-bb6f-3e5ff9d5501a admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:18.928042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ae296-ad1d-4e15-bb6f-3e5ff9d5501a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:37:18.928580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ae296-ad1d-4e15-bb6f-3e5ff9d5501a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:18.930023 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ae296-ad1d-4e15-bb6f-3e5ff9d5501a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:18.945325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1352/2716] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:37:18.949753 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d966fde-8576-4433-be59-bd0102dad5f2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:18.962357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d966fde-8576-4433-be59-bd0102dad5f2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:18.981513 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f872c-42fd-4d11-9b33-1276147a11bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:18.983015 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f872c-42fd-4d11-9b33-1276147a11bc admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:18.983518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f872c-42fd-4d11-9b33-1276147a11bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:18.983841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f872c-42fd-4d11-9b33-1276147a11bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:18.984624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f872c-42fd-4d11-9b33-1276147a11bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:18.986782 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f872c-42fd-4d11-9b33-1276147a11bc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.016738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1365/2717] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:37:18 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:37:19.020817 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ae296-ad1d-4e15-bb6f-3e5ff9d5501a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.031529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ae296-ad1d-4e15-bb6f-3e5ff9d5501a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.092131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36fbd9-ce2f-473d-be20-2de3df47b706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.092824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36fbd9-ce2f-473d-be20-2de3df47b706 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.093140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36fbd9-ce2f-473d-be20-2de3df47b706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.093426 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36fbd9-ce2f-473d-be20-2de3df47b706 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.094163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36fbd9-ce2f-473d-be20-2de3df47b706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.096125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36fbd9-ce2f-473d-be20-2de3df47b706 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.125957 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1353/2718] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:37:19 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:37:19.127608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f872c-42fd-4d11-9b33-1276147a11bc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.139032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f872c-42fd-4d11-9b33-1276147a11bc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.143810 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a720658-3ccd-478c-80b4-281b0d474824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.144494 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a720658-3ccd-478c-80b4-281b0d474824 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.144781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a720658-3ccd-478c-80b4-281b0d474824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.145061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a720658-3ccd-478c-80b4-281b0d474824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.145804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a720658-3ccd-478c-80b4-281b0d474824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.148224 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a720658-3ccd-478c-80b4-281b0d474824 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.159065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1366/2719] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:19.163831 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36fbd9-ce2f-473d-be20-2de3df47b706 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.174129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36fbd9-ce2f-473d-be20-2de3df47b706 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.179571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f66122-6d4f-4322-9595-513e6d375e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.180179 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f66122-6d4f-4322-9595-513e6d375e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.180466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f66122-6d4f-4322-9595-513e6d375e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.181135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f66122-6d4f-4322-9595-513e6d375e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.181561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f66122-6d4f-4322-9595-513e6d375e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.183221 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f66122-6d4f-4322-9595-513e6d375e71 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.194552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1354/2720] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:19.199137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a720658-3ccd-478c-80b4-281b0d474824 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.209856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a720658-3ccd-478c-80b4-281b0d474824 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.215197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf997ae-721f-4e97-91c9-5e0cb56ac193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.216200 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf997ae-721f-4e97-91c9-5e0cb56ac193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.216489 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf997ae-721f-4e97-91c9-5e0cb56ac193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.216765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf997ae-721f-4e97-91c9-5e0cb56ac193 admin admin] PATH_INFO: `/v3/projects/68a53ca89ddd4c3c9473be8fd0806566/users/8fe97cee6c2c4a1e8972138ee431710a/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.232832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf997ae-721f-4e97-91c9-5e0cb56ac193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a53ca89ddd4c3c9473be8fd0806566, user_id=8fe97cee6c2c4a1e8972138ee431710a, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.235590 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf997ae-721f-4e97-91c9-5e0cb56ac193 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.251001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1367/2721] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:19 2022] PUT /identity/v3/projects/68a53ca89ddd4c3c9473be8fd0806566/users/8fe97cee6c2c4a1e8972138ee431710a/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:19.261693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22fe8-bfe5-40ff-b4dd-21e3f6a8899f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.261986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22fe8-bfe5-40ff-b4dd-21e3f6a8899f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.262295 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22fe8-bfe5-40ff-b4dd-21e3f6a8899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.290126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a8d22fe8-bfe5-40ff-b4dd-21e3f6a8899f None None] MFA Rules not processed for user `8fe97cee6c2c4a1e8972138ee431710a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:19.291520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a8d22fe8-bfe5-40ff-b4dd-21e3f6a8899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:19.313662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:19.375608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1355/2722] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:19.380323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf997ae-721f-4e97-91c9-5e0cb56ac193 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.449100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf997ae-721f-4e97-91c9-5e0cb56ac193 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.454183 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57feb0-fed9-4175-9ed1-6da34822c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.454862 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57feb0-fed9-4175-9ed1-6da34822c00c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.455146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57feb0-fed9-4175-9ed1-6da34822c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.455419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57feb0-fed9-4175-9ed1-6da34822c00c admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.456132 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57feb0-fed9-4175-9ed1-6da34822c00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.458119 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57feb0-fed9-4175-9ed1-6da34822c00c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.488935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1368/2723] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:37:19 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:19.490458 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22fe8-bfe5-40ff-b4dd-21e3f6a8899f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.501157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22fe8-bfe5-40ff-b4dd-21e3f6a8899f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.562199 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bc7d2-383a-42cd-9745-9d60edea6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.562896 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc7d2-383a-42cd-9745-9d60edea6813 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.563387 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc7d2-383a-42cd-9745-9d60edea6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.563676 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc7d2-383a-42cd-9745-9d60edea6813 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.564376 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bc7d2-383a-42cd-9745-9d60edea6813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.566363 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bc7d2-383a-42cd-9745-9d60edea6813 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.588304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1356/2724] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:37:19 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:19.592398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57feb0-fed9-4175-9ed1-6da34822c00c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.603664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57feb0-fed9-4175-9ed1-6da34822c00c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.609695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bec99-7437-402c-9fd2-bc1b412f14c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.610517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bec99-7437-402c-9fd2-bc1b412f14c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.610884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bec99-7437-402c-9fd2-bc1b412f14c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.611170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bec99-7437-402c-9fd2-bc1b412f14c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.611889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bec99-7437-402c-9fd2-bc1b412f14c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.613528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bec99-7437-402c-9fd2-bc1b412f14c8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.628568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1369/2725] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:19.632841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bc7d2-383a-42cd-9745-9d60edea6813 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.643855 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bc7d2-383a-42cd-9745-9d60edea6813 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.648868 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47ea4d-3509-48eb-9efe-29e148cade5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.649765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47ea4d-3509-48eb-9efe-29e148cade5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.650048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47ea4d-3509-48eb-9efe-29e148cade5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.650364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47ea4d-3509-48eb-9efe-29e148cade5b admin admin] PATH_INFO: `/v3/projects/abdce15dbf984b12af6ee0b0226441bf/users/3a258cf6db8d4e639d2ec2d90e9643bd/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.665457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47ea4d-3509-48eb-9efe-29e148cade5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdce15dbf984b12af6ee0b0226441bf, user_id=3a258cf6db8d4e639d2ec2d90e9643bd, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.668328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47ea4d-3509-48eb-9efe-29e148cade5b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.683326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1357/2726] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:19 2022] PUT /identity/v3/projects/abdce15dbf984b12af6ee0b0226441bf/users/3a258cf6db8d4e639d2ec2d90e9643bd/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:19.687531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bec99-7437-402c-9fd2-bc1b412f14c8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.698012 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bec99-7437-402c-9fd2-bc1b412f14c8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.744650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:19.756203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b2b4c-7adf-4b9c-9e2a-9c3a551e3a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.756878 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b2b4c-7adf-4b9c-9e2a-9c3a551e3a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.757162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b2b4c-7adf-4b9c-9e2a-9c3a551e3a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.757439 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b2b4c-7adf-4b9c-9e2a-9c3a551e3a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.758187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b2b4c-7adf-4b9c-9e2a-9c3a551e3a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.759824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b2b4c-7adf-4b9c-9e2a-9c3a551e3a31 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.769729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1370/2727] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:19.774112 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47ea4d-3509-48eb-9efe-29e148cade5b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.785034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47ea4d-3509-48eb-9efe-29e148cade5b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:19.790716 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcbf9e-2747-44c4-83a5-f716ec775f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:19.791673 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcbf9e-2747-44c4-83a5-f716ec775f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.791970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcbf9e-2747-44c4-83a5-f716ec775f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.792243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcbf9e-2747-44c4-83a5-f716ec775f4a admin admin] PATH_INFO: `/v3/projects/abdce15dbf984b12af6ee0b0226441bf/users/3a258cf6db8d4e639d2ec2d90e9643bd/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.794555 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcbf9e-2747-44c4-83a5-f716ec775f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdce15dbf984b12af6ee0b0226441bf, user_id=3a258cf6db8d4e639d2ec2d90e9643bd, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:19.797252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcbf9e-2747-44c4-83a5-f716ec775f4a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:19.808466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1358/2728] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:19 2022] PUT /identity/v3/projects/abdce15dbf984b12af6ee0b0226441bf/users/3a258cf6db8d4e639d2ec2d90e9643bd/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:19.869629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0eac-ec64-4c61-b6ee-a4d643eb492f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:19.869924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0eac-ec64-4c61-b6ee-a4d643eb492f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:19.870240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f0eac-ec64-4c61-b6ee-a4d643eb492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:19.898738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2e0f0eac-ec64-4c61-b6ee-a4d643eb492f None None] MFA Rules not processed for user `3a258cf6db8d4e639d2ec2d90e9643bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:19.899961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2e0f0eac-ec64-4c61-b6ee-a4d643eb492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:19.968760 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1371/2729] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:19.981060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcbf9e-2747-44c4-83a5-f716ec775f4a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:19.982938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2bcbf9e-2747-44c4-83a5-f716ec775f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:20.044124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcbf9e-2747-44c4-83a5-f716ec775f4a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:20.048375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3383-956b-4ffb-8e0b-b26081dfd4ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:20.049031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3383-956b-4ffb-8e0b-b26081dfd4ac service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:20.049314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3383-956b-4ffb-8e0b-b26081dfd4ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:20.049591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3383-956b-4ffb-8e0b-b26081dfd4ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:20.078872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:20.108367 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e3383-956b-4ffb-8e0b-b26081dfd4ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:20.109828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e3383-956b-4ffb-8e0b-b26081dfd4ac service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:20.118880 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1359/2730] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:24.364206 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f0eac-ec64-4c61-b6ee-a4d643eb492f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:24.366541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2e0f0eac-ec64-4c61-b6ee-a4d643eb492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:24.379709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f0eac-ec64-4c61-b6ee-a4d643eb492f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:24.388804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d50893-7d8c-4a3b-b61f-85fb1c617f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:24.388804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d50893-7d8c-4a3b-b61f-85fb1c617f7f service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:24.388804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d50893-7d8c-4a3b-b61f-85fb1c617f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:24.388804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d50893-7d8c-4a3b-b61f-85fb1c617f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:24.404424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d50893-7d8c-4a3b-b61f-85fb1c617f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:24.406827 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d50893-7d8c-4a3b-b61f-85fb1c617f7f service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:24.419197 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1372/2731] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:30.115231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=14 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:33.109503 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646dd77-e31b-4a99-8167-6a7737b83f2c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:33.110080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646dd77-e31b-4a99-8167-6a7737b83f2c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:33.110080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646dd77-e31b-4a99-8167-6a7737b83f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:33.171875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9646dd77-e31b-4a99-8167-6a7737b83f2c None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:33.173080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9646dd77-e31b-4a99-8167-6a7737b83f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:33.241849 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1360/2732] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 13:37:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:33.291682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d50893-7d8c-4a3b-b61f-85fb1c617f7f service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:33.293473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-81d50893-7d8c-4a3b-b61f-85fb1c617f7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:33.398059 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d50893-7d8c-4a3b-b61f-85fb1c617f7f service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:33.404381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d3b9a-8d0d-4618-89b1-02f7f1d2cd68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:33.405045 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d3b9a-8d0d-4618-89b1-02f7f1d2cd68 service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:33.405328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d3b9a-8d0d-4618-89b1-02f7f1d2cd68 service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:33.405638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d3b9a-8d0d-4618-89b1-02f7f1d2cd68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:33.414945 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d3b9a-8d0d-4618-89b1-02f7f1d2cd68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:33.416646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d3b9a-8d0d-4618-89b1-02f7f1d2cd68 service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:33.425276 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1373/2733] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:37:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:37:34.673437 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646dd77-e31b-4a99-8167-6a7737b83f2c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:34.750257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646dd77-e31b-4a99-8167-6a7737b83f2c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:34.755608 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:34.757129 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:34.757455 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:34.757735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] PATH_INFO: `/v3/users/8fe97cee6c2c4a1e8972138ee431710a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:34.759071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe97cee6c2c4a1e8972138ee431710a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:34.761314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:34.828150 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe97cee6c2c4a1e8972138ee431710a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:34.846778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe97cee6c2c4a1e8972138ee431710a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:34.848735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe97cee6c2c4a1e8972138ee431710a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:34.851641 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:34.861826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe97cee6c2c4a1e8972138ee431710a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:34.872098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe97cee6c2c4a1e8972138ee431710a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:34.882072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1361/2734] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:37:34 2022] DELETE /identity/v3/users/8fe97cee6c2c4a1e8972138ee431710a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:34.887299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69e1ca-fb72-4abf-a0f5-02a1ff928f0a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:34.887807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69e1ca-fb72-4abf-a0f5-02a1ff928f0a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:34.888134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69e1ca-fb72-4abf-a0f5-02a1ff928f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:34.907942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9b69e1ca-fb72-4abf-a0f5-02a1ff928f0a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:34.909622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9b69e1ca-fb72-4abf-a0f5-02a1ff928f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:34.942290 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:34.995333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1374/2735] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:35.006596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:35.008993 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:35.081635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec191df4-450b-4061-8939-ad0921bea353 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:35.089224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97cb35-b801-423b-850a-4105429e4150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:35.089898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97cb35-b801-423b-850a-4105429e4150 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:35.090214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97cb35-b801-423b-850a-4105429e4150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:35.090486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97cb35-b801-423b-850a-4105429e4150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:35.100491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97cb35-b801-423b-850a-4105429e4150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:35.101953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97cb35-b801-423b-850a-4105429e4150 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:35.113124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1362/2736] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:35.451530 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69e1ca-fb72-4abf-a0f5-02a1ff928f0a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:35.453063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9b69e1ca-fb72-4abf-a0f5-02a1ff928f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:35.467162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69e1ca-fb72-4abf-a0f5-02a1ff928f0a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:35.476130 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:35.477345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:35.477911 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:35.478444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] PATH_INFO: `/v3/projects/68a53ca89ddd4c3c9473be8fd0806566` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:35.480016 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a53ca89ddd4c3c9473be8fd0806566)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:35.483595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:35.567675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a53ca89ddd4c3c9473be8fd0806566', 'request_id': 'req-a4099c53-3010-4d2c-96ef-3f142b1d8099'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.575382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a53ca89ddd4c3c9473be8fd0806566', 'request_id': 'req-a4099c53-3010-4d2c-96ef-3f142b1d8099'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.585265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a53ca89ddd4c3c9473be8fd0806566', 'request_id': 'req-a4099c53-3010-4d2c-96ef-3f142b1d8099'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.601248 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] The token cache is being invalidate because project 68a53ca89ddd4c3c9473be8fd0806566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:37:35.601628 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.602432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.604709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1375/2737] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:37:35 2022] DELETE /identity/v3/projects/68a53ca89ddd4c3c9473be8fd0806566 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:35.609010 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97cb35-b801-423b-850a-4105429e4150 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:35.620139 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97cb35-b801-423b-850a-4105429e4150 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:35.706994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:35.708306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:35.708932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:35.709321 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] PATH_INFO: `/v3/users/3a258cf6db8d4e639d2ec2d90e9643bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:35.711493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a258cf6db8d4e639d2ec2d90e9643bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:35.714830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:35.781689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a258cf6db8d4e639d2ec2d90e9643bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.801344 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a258cf6db8d4e639d2ec2d90e9643bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.802487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a258cf6db8d4e639d2ec2d90e9643bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.812439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a258cf6db8d4e639d2ec2d90e9643bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.821219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4770ad0e-c8c6-4ea8-9626-6a65d0b7f0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a258cf6db8d4e639d2ec2d90e9643bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:35.829260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1363/2738] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:37:35 2022] DELETE /identity/v3/users/3a258cf6db8d4e639d2ec2d90e9643bd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:36.206917 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:36.209335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:36.226222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4099c53-3010-4d2c-96ef-3f142b1d8099 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:36.294303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:36.295232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.295517 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.295793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] PATH_INFO: `/v3/projects/abdce15dbf984b12af6ee0b0226441bf` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:36.297575 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abdce15dbf984b12af6ee0b0226441bf)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:36.306545 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:36.390996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abdce15dbf984b12af6ee0b0226441bf', 'request_id': 'req-2b77cac3-7e23-4482-b6c7-69aed052a494'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:36.400717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abdce15dbf984b12af6ee0b0226441bf', 'request_id': 'req-2b77cac3-7e23-4482-b6c7-69aed052a494'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:36.400717 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:36.409309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abdce15dbf984b12af6ee0b0226441bf', 'request_id': 'req-2b77cac3-7e23-4482-b6c7-69aed052a494'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:36.423759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] The token cache is being invalidate because project abdce15dbf984b12af6ee0b0226441bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:37:36.424201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:36.425289 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2b77cac3-7e23-4482-b6c7-69aed052a494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:36.432639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1376/2739] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:37:36 2022] DELETE /identity/v3/projects/abdce15dbf984b12af6ee0b0226441bf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:36.434596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08f5a1-8bac-4849-8c8e-29e26638b3ff None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.435095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08f5a1-8bac-4849-8c8e-29e26638b3ff None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.435466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08f5a1-8bac-4849-8c8e-29e26638b3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:36.445730 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:36.459901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0b08f5a1-8bac-4849-8c8e-29e26638b3ff None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:36.462286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0b08f5a1-8bac-4849-8c8e-29e26638b3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:36.541071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1364/2740] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:36.548999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b79c2-bec5-455c-a00e-01de11a0f769 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.549694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b79c2-bec5-455c-a00e-01de11a0f769 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.550191 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b79c2-bec5-455c-a00e-01de11a0f769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:36.571688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-903b79c2-bec5-455c-a00e-01de11a0f769 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:36.572962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-903b79c2-bec5-455c-a00e-01de11a0f769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:36.585214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1377/2741] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:36.591110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08f5a1-8bac-4849-8c8e-29e26638b3ff None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:36.603086 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08f5a1-8bac-4849-8c8e-29e26638b3ff None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:36.610496 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995275e1-8213-492e-a3bc-358e844907da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:36.611462 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995275e1-8213-492e-a3bc-358e844907da admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.611911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995275e1-8213-492e-a3bc-358e844907da admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.612368 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995275e1-8213-492e-a3bc-358e844907da admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:36.613486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995275e1-8213-492e-a3bc-358e844907da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:37:36.613994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995275e1-8213-492e-a3bc-358e844907da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:36.616696 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995275e1-8213-492e-a3bc-358e844907da admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:36.635366 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1365/2742] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:37:36.635995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b79c2-bec5-455c-a00e-01de11a0f769 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:36.645440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b79c2-bec5-455c-a00e-01de11a0f769 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:36.651050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7128184-4235-489e-adef-ee313e6c4b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:36.651858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7128184-4235-489e-adef-ee313e6c4b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.652220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7128184-4235-489e-adef-ee313e6c4b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.652598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7128184-4235-489e-adef-ee313e6c4b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:36.653656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7128184-4235-489e-adef-ee313e6c4b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:36.655849 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7128184-4235-489e-adef-ee313e6c4b9a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:36.696657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1378/2743] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:37:36 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:37:36.698243 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995275e1-8213-492e-a3bc-358e844907da admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:36.713699 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995275e1-8213-492e-a3bc-358e844907da admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:36.795261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d0c3b-592a-44b7-a25f-1090a9640b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:36.796046 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d0c3b-592a-44b7-a25f-1090a9640b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.796336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d0c3b-592a-44b7-a25f-1090a9640b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.796713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d0c3b-592a-44b7-a25f-1090a9640b77 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:36.797867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d0c3b-592a-44b7-a25f-1090a9640b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:36.801164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d0c3b-592a-44b7-a25f-1090a9640b77 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:36.832729 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1366/2744] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:37:36 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:36.834580 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7128184-4235-489e-adef-ee313e6c4b9a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:36.846987 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7128184-4235-489e-adef-ee313e6c4b9a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:36.853140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca824b5e-d385-4ca6-a09c-c49ecd4203ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:36.854238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca824b5e-d385-4ca6-a09c-c49ecd4203ef admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.854532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca824b5e-d385-4ca6-a09c-c49ecd4203ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.855082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca824b5e-d385-4ca6-a09c-c49ecd4203ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:36.856742 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca824b5e-d385-4ca6-a09c-c49ecd4203ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:36.859257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca824b5e-d385-4ca6-a09c-c49ecd4203ef admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:36.875520 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1379/2745] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:36.878909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d0c3b-592a-44b7-a25f-1090a9640b77 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:36.892617 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d0c3b-592a-44b7-a25f-1090a9640b77 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:36.902260 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9613a-9fe5-4849-aa69-d2daaf55e700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:36.903695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9613a-9fe5-4849-aa69-d2daaf55e700 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.904021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9613a-9fe5-4849-aa69-d2daaf55e700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.904644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9613a-9fe5-4849-aa69-d2daaf55e700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:36.905929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9613a-9fe5-4849-aa69-d2daaf55e700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:36.908123 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9613a-9fe5-4849-aa69-d2daaf55e700 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:36.921712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1367/2746] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:36.925779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca824b5e-d385-4ca6-a09c-c49ecd4203ef admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:36.938302 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca824b5e-d385-4ca6-a09c-c49ecd4203ef admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:36.943675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad0551-bc33-44fb-b9e7-2696d60806d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:36.944588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad0551-bc33-44fb-b9e7-2696d60806d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.944872 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad0551-bc33-44fb-b9e7-2696d60806d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.945154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad0551-bc33-44fb-b9e7-2696d60806d8 admin admin] PATH_INFO: `/v3/projects/fb88c47a983049f18b2c56f393aa5fe3/users/1d8a73fcd08545de8cf8c52285381031/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:36.965924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad0551-bc33-44fb-b9e7-2696d60806d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb88c47a983049f18b2c56f393aa5fe3, user_id=1d8a73fcd08545de8cf8c52285381031, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:36.969468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad0551-bc33-44fb-b9e7-2696d60806d8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:36.987767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1380/2747] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:36 2022] PUT /identity/v3/projects/fb88c47a983049f18b2c56f393aa5fe3/users/1d8a73fcd08545de8cf8c52285381031/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:36.999293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b0140-4492-461b-8398-ca39026758db None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:36.999591 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b0140-4492-461b-8398-ca39026758db None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:36.999878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b0140-4492-461b-8398-ca39026758db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:37.035235 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5c6b0140-4492-461b-8398-ca39026758db None None] MFA Rules not processed for user `1d8a73fcd08545de8cf8c52285381031`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:37.036583 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5c6b0140-4492-461b-8398-ca39026758db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:37.104713 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:37.116277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1368/2748] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:37.121321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad0551-bc33-44fb-b9e7-2696d60806d8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:37.123179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-38ad0551-bc33-44fb-b9e7-2696d60806d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:37.187792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad0551-bc33-44fb-b9e7-2696d60806d8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:37.191681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5a259-0a04-4336-8187-ca21b2b4f850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:37.192358 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5a259-0a04-4336-8187-ca21b2b4f850 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:37.192635 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5a259-0a04-4336-8187-ca21b2b4f850 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:37.193151 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5a259-0a04-4336-8187-ca21b2b4f850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:37.203974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5a259-0a04-4336-8187-ca21b2b4f850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:37.206190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5a259-0a04-4336-8187-ca21b2b4f850 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:37.217033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1381/2749] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:37.239658 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b0140-4492-461b-8398-ca39026758db None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:37.319331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b0140-4492-461b-8398-ca39026758db None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:37.324633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:37.325625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:37.326130 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:37.326287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] PATH_INFO: `/v3/users/1d8a73fcd08545de8cf8c52285381031` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:37.328977 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8a73fcd08545de8cf8c52285381031)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:37.331045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:37.396974 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8a73fcd08545de8cf8c52285381031'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:37.413151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8a73fcd08545de8cf8c52285381031'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:37.414668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8a73fcd08545de8cf8c52285381031'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:37.426257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8a73fcd08545de8cf8c52285381031'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:37.436612 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8a73fcd08545de8cf8c52285381031'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:37.444242 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1369/2750] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:37:37 2022] DELETE /identity/v3/users/1d8a73fcd08545de8cf8c52285381031 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:37.448809 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f499fe-250d-4f32-adfc-e686c447adb0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:37.449272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f499fe-250d-4f32-adfc-e686c447adb0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:37.449728 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f499fe-250d-4f32-adfc-e686c447adb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:37.476778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f8f499fe-250d-4f32-adfc-e686c447adb0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:37.478551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f8f499fe-250d-4f32-adfc-e686c447adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:37.559923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1382/2751] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:37.566857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:37.568468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:37.648947 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967da065-9a29-4949-a36b-2053b8298243 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:37.654252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28d664-6fbb-494c-beb6-32b26ef4fafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:37.654952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28d664-6fbb-494c-beb6-32b26ef4fafd service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:37.655241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28d664-6fbb-494c-beb6-32b26ef4fafd service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:37.655520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28d664-6fbb-494c-beb6-32b26ef4fafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:37.670082 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28d664-6fbb-494c-beb6-32b26ef4fafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:37.671596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28d664-6fbb-494c-beb6-32b26ef4fafd service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:37.682981 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1370/2752] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:38.004029 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f499fe-250d-4f32-adfc-e686c447adb0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:38.006033 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f8f499fe-250d-4f32-adfc-e686c447adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:38.023783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f499fe-250d-4f32-adfc-e686c447adb0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:38.031775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:38.032781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.033322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.033639 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] PATH_INFO: `/v3/projects/fb88c47a983049f18b2c56f393aa5fe3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.035366 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb88c47a983049f18b2c56f393aa5fe3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:38.037765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:38.060447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:38.101818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb88c47a983049f18b2c56f393aa5fe3', 'request_id': 'req-8b1dd90b-6e87-4762-9635-796054fec55e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:38.109201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb88c47a983049f18b2c56f393aa5fe3', 'request_id': 'req-8b1dd90b-6e87-4762-9635-796054fec55e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:38.119646 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb88c47a983049f18b2c56f393aa5fe3', 'request_id': 'req-8b1dd90b-6e87-4762-9635-796054fec55e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:38.134775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] The token cache is being invalidate because project fb88c47a983049f18b2c56f393aa5fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:37:38.135069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:38.135718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8b1dd90b-6e87-4762-9635-796054fec55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:38.138319 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1383/2753] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:37:38 2022] DELETE /identity/v3/projects/fb88c47a983049f18b2c56f393aa5fe3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:38.142477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bb0a-bd3c-4aaf-a5ba-50a3556e09b6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.142992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bb0a-bd3c-4aaf-a5ba-50a3556e09b6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.143076 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bb0a-bd3c-4aaf-a5ba-50a3556e09b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.165084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-47f0bb0a-bd3c-4aaf-a5ba-50a3556e09b6 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:38.166632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-47f0bb0a-bd3c-4aaf-a5ba-50a3556e09b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:38.190132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:38.255768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1371/2754] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:38.257971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1677d7-9258-4232-993d-71c1134fbaea None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.259009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1677d7-9258-4232-993d-71c1134fbaea None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.259273 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1677d7-9258-4232-993d-71c1134fbaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.280440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2c1677d7-9258-4232-993d-71c1134fbaea None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:38.281851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2c1677d7-9258-4232-993d-71c1134fbaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:38.290904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1384/2755] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:38.295225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bb0a-bd3c-4aaf-a5ba-50a3556e09b6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:38.308588 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bb0a-bd3c-4aaf-a5ba-50a3556e09b6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:38.318693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a50f3-bd2f-49f4-9f05-293657e2cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:38.319595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a50f3-bd2f-49f4-9f05-293657e2cf51 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.320131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a50f3-bd2f-49f4-9f05-293657e2cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.320505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a50f3-bd2f-49f4-9f05-293657e2cf51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.321487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a50f3-bd2f-49f4-9f05-293657e2cf51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:37:38.321924 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a50f3-bd2f-49f4-9f05-293657e2cf51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:38.324162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a50f3-bd2f-49f4-9f05-293657e2cf51 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:38.340983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1372/2756] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:37:38.342321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1677d7-9258-4232-993d-71c1134fbaea None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:38.360741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1677d7-9258-4232-993d-71c1134fbaea None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:38.367076 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bf4af-8206-4f57-a30d-8c03da5eba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:38.368034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bf4af-8206-4f57-a30d-8c03da5eba3f admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.368608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bf4af-8206-4f57-a30d-8c03da5eba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.368888 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bf4af-8206-4f57-a30d-8c03da5eba3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.370067 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bf4af-8206-4f57-a30d-8c03da5eba3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:38.372769 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bf4af-8206-4f57-a30d-8c03da5eba3f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:38.406429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1385/2757] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:37:38 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:38.412980 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a50f3-bd2f-49f4-9f05-293657e2cf51 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:38.425169 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a50f3-bd2f-49f4-9f05-293657e2cf51 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:38.492222 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a52c7b-7c2c-4b73-8a86-d616b820027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:38.492951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a52c7b-7c2c-4b73-8a86-d616b820027d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.493280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a52c7b-7c2c-4b73-8a86-d616b820027d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.493552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a52c7b-7c2c-4b73-8a86-d616b820027d admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.494345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a52c7b-7c2c-4b73-8a86-d616b820027d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:38.496388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a52c7b-7c2c-4b73-8a86-d616b820027d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:38.517985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1373/2758] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:37:38 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:37:38.522906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bf4af-8206-4f57-a30d-8c03da5eba3f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:38.535390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bf4af-8206-4f57-a30d-8c03da5eba3f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:38.540904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a09e5-1ec6-45a4-a8f4-756461b102b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:38.541597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a09e5-1ec6-45a4-a8f4-756461b102b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.541882 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a09e5-1ec6-45a4-a8f4-756461b102b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.542202 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a09e5-1ec6-45a4-a8f4-756461b102b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.542940 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a09e5-1ec6-45a4-a8f4-756461b102b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:38.544594 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a09e5-1ec6-45a4-a8f4-756461b102b9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:38.557586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1386/2759] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:38.562631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a52c7b-7c2c-4b73-8a86-d616b820027d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:38.573934 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a52c7b-7c2c-4b73-8a86-d616b820027d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:38.579041 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fbadc-2103-45c5-bbfa-a77aee220066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:38.579958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fbadc-2103-45c5-bbfa-a77aee220066 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.580343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fbadc-2103-45c5-bbfa-a77aee220066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.580736 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fbadc-2103-45c5-bbfa-a77aee220066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.581571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fbadc-2103-45c5-bbfa-a77aee220066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:38.583416 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fbadc-2103-45c5-bbfa-a77aee220066 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:38.599883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1374/2760] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:37:38.605740 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a09e5-1ec6-45a4-a8f4-756461b102b9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:38.620692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a09e5-1ec6-45a4-a8f4-756461b102b9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:38.625687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e7207-4b44-41f1-9fd5-e52b7a4de1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:38.626778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e7207-4b44-41f1-9fd5-e52b7a4de1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.627184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e7207-4b44-41f1-9fd5-e52b7a4de1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.627484 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e7207-4b44-41f1-9fd5-e52b7a4de1ec admin admin] PATH_INFO: `/v3/projects/b930725523554152a3cfe3be04ec1362/users/df6ee253918c48aea90c6aa3eb998cc5/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.646240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e7207-4b44-41f1-9fd5-e52b7a4de1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b930725523554152a3cfe3be04ec1362, user_id=df6ee253918c48aea90c6aa3eb998cc5, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:38.649076 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e7207-4b44-41f1-9fd5-e52b7a4de1ec admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:38.664345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1387/2761] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:37:38 2022] PUT /identity/v3/projects/b930725523554152a3cfe3be04ec1362/users/df6ee253918c48aea90c6aa3eb998cc5/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:37:38.677754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5923b-532a-4750-ae15-45a99a98d106 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.678285 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5923b-532a-4750-ae15-45a99a98d106 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.678518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5923b-532a-4750-ae15-45a99a98d106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.717091 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-30a5923b-532a-4750-ae15-45a99a98d106 None None] MFA Rules not processed for user `df6ee253918c48aea90c6aa3eb998cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:38.718369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-30a5923b-532a-4750-ae15-45a99a98d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:38.797918 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1375/2762] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:38.809581 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e7207-4b44-41f1-9fd5-e52b7a4de1ec admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:38.811574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9a9e7207-4b44-41f1-9fd5-e52b7a4de1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:38.878510 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e7207-4b44-41f1-9fd5-e52b7a4de1ec admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:38.882991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f7e73-0b87-4b31-88aa-3539a2ffb262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:38.883690 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f7e73-0b87-4b31-88aa-3539a2ffb262 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:38.883966 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f7e73-0b87-4b31-88aa-3539a2ffb262 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:38.884242 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f7e73-0b87-4b31-88aa-3539a2ffb262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:38.894249 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f7e73-0b87-4b31-88aa-3539a2ffb262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:38.895851 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f7e73-0b87-4b31-88aa-3539a2ffb262 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:38.906514 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1388/2763] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:37:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:37:40.340923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8565156-5706-43fc-8d17-e65ef338218c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:40.341506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8565156-5706-43fc-8d17-e65ef338218c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:40.342131 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8565156-5706-43fc-8d17-e65ef338218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:40.376177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e8565156-5706-43fc-8d17-e65ef338218c None None] MFA Rules not processed for user `df6ee253918c48aea90c6aa3eb998cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:40.377886 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e8565156-5706-43fc-8d17-e65ef338218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:40.390234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1376/2764] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:37:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:48.901566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:49.341668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b29e6-9c95-4125-bdff-ab326e3f0969 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:49.341958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b29e6-9c95-4125-bdff-ab326e3f0969 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:49.342294 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b29e6-9c95-4125-bdff-ab326e3f0969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:49.361894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a37b29e6-9c95-4125-bdff-ab326e3f0969 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:49.363073 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a37b29e6-9c95-4125-bdff-ab326e3f0969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:49.422236 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1389/2765] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 13:37:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:49.436602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8565156-5706-43fc-8d17-e65ef338218c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:49.438073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e8565156-5706-43fc-8d17-e65ef338218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:49.452346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:49.526374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8565156-5706-43fc-8d17-e65ef338218c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:49.532293 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6fd9f-fee6-43fb-96fd-4be7c71bc568 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:49.532979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6fd9f-fee6-43fb-96fd-4be7c71bc568 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:49.533261 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6fd9f-fee6-43fb-96fd-4be7c71bc568 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:49.533539 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6fd9f-fee6-43fb-96fd-4be7c71bc568 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:49.543198 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6fd9f-fee6-43fb-96fd-4be7c71bc568 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:49.544842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6fd9f-fee6-43fb-96fd-4be7c71bc568 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:49.553951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1377/2766] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:37:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:37:51.581804 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b29e6-9c95-4125-bdff-ab326e3f0969 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:51.583409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a37b29e6-9c95-4125-bdff-ab326e3f0969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:51.659148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b29e6-9c95-4125-bdff-ab326e3f0969 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:51.664354 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:51.665254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:51.665607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:51.665821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] PATH_INFO: `/v3/users/0a3da974f5be44e2946fc0d3b9423d9d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:51.667052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3da974f5be44e2946fc0d3b9423d9d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:51.668998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:51.717834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3da974f5be44e2946fc0d3b9423d9d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:51.718541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3da974f5be44e2946fc0d3b9423d9d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:51.719150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3da974f5be44e2946fc0d3b9423d9d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:51.726232 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3da974f5be44e2946fc0d3b9423d9d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:51.734992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-769e647d-ed3d-4067-be00-8512cb8165c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3da974f5be44e2946fc0d3b9423d9d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:51.752873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1390/2767] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:37:51 2022] DELETE /identity/v3/users/0a3da974f5be44e2946fc0d3b9423d9d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:51.947453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6fd9f-fee6-43fb-96fd-4be7c71bc568 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:51.959170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6fd9f-fee6-43fb-96fd-4be7c71bc568 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:52.018571 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:52.019463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:52.019747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:52.020025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] PATH_INFO: `/v3/projects/0913f851ff164415a466c466de1ece6e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:52.022240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0913f851ff164415a466c466de1ece6e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:52.024460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:52.082772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0913f851ff164415a466c466de1ece6e', 'request_id': 'req-5f7c4430-be69-4f0e-8c0b-f038405db7e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:52.089187 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0913f851ff164415a466c466de1ece6e', 'request_id': 'req-5f7c4430-be69-4f0e-8c0b-f038405db7e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:52.095815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0913f851ff164415a466c466de1ece6e', 'request_id': 'req-5f7c4430-be69-4f0e-8c0b-f038405db7e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:52.110661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] The token cache is being invalidate because project 0913f851ff164415a466c466de1ece6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:37:52.110951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:52.111624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:37:52.113247 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1378/2768] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:37:51 2022] DELETE /identity/v3/projects/0913f851ff164415a466c466de1ece6e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:37:57.791557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cb013-64bd-4623-b154-7c127f577f1f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:57.792092 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cb013-64bd-4623-b154-7c127f577f1f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:57.792193 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cb013-64bd-4623-b154-7c127f577f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:57.811481 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fe5cb013-64bd-4623-b154-7c127f577f1f None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:57.812695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fe5cb013-64bd-4623-b154-7c127f577f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:57.836799 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:57.877121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1391/2769] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 13:37:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:57.889347 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:57.890843 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:57.932048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:37:57.969609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c4430-be69-4f0e-8c0b-f038405db7e9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:57.976903 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14b42-94f5-4880-989f-1991d665132f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:57.977560 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14b42-94f5-4880-989f-1991d665132f service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:57.977848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14b42-94f5-4880-989f-1991d665132f service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:57.978116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14b42-94f5-4880-989f-1991d665132f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:57.987495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab14b42-94f5-4880-989f-1991d665132f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:57.989113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab14b42-94f5-4880-989f-1991d665132f service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:57.997853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1379/2770] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:37:58.553579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880b355-5ed0-4149-b1f6-8afcc6be577e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:58.553875 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880b355-5ed0-4149-b1f6-8afcc6be577e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:58.554203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880b355-5ed0-4149-b1f6-8afcc6be577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:58.573190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4880b355-5ed0-4149-b1f6-8afcc6be577e None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:58.574440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4880b355-5ed0-4149-b1f6-8afcc6be577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:58.583438 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1392/2771] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 13:37:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:58.595386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14b42-94f5-4880-989f-1991d665132f service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:58.607190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14b42-94f5-4880-989f-1991d665132f service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:58.613739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88a657-e732-47c2-8a99-fc5953a2c2c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:58.614671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88a657-e732-47c2-8a99-fc5953a2c2c0 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:58.614671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88a657-e732-47c2-8a99-fc5953a2c2c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:58.614946 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88a657-e732-47c2-8a99-fc5953a2c2c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:58.623901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88a657-e732-47c2-8a99-fc5953a2c2c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:58.625490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88a657-e732-47c2-8a99-fc5953a2c2c0 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:58.633931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1380/2772] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:37:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:37:58.837503 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8422-2178-4b69-92b5-a7a121ec3ba5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:58.837962 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8422-2178-4b69-92b5-a7a121ec3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:58.838066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8422-2178-4b69-92b5-a7a121ec3ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:58.856184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d7cb8422-2178-4b69-92b5-a7a121ec3ba5 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:58.857367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d7cb8422-2178-4b69-92b5-a7a121ec3ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:58.865112 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1393/2773] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 17 13:37:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:58.877276 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88a657-e732-47c2-8a99-fc5953a2c2c0 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:58.888068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88a657-e732-47c2-8a99-fc5953a2c2c0 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:58.893252 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f997a-9c10-4726-9265-6746b13cab98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:58.893847 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f997a-9c10-4726-9265-6746b13cab98 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:58.894142 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f997a-9c10-4726-9265-6746b13cab98 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:58.894552 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f997a-9c10-4726-9265-6746b13cab98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:58.902874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f997a-9c10-4726-9265-6746b13cab98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:58.904456 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f997a-9c10-4726-9265-6746b13cab98 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:58.912548 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1381/2774] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:37:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:37:59.260066 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e33198-8669-464e-9aee-37eef21761a3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:59.260268 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e33198-8669-464e-9aee-37eef21761a3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:59.260541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e33198-8669-464e-9aee-37eef21761a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:59.279548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c1e33198-8669-464e-9aee-37eef21761a3 None None] MFA Rules not processed for user `3b34545615e447329344a942cd31c12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:37:59.280772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c1e33198-8669-464e-9aee-37eef21761a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:37:59.291181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1394/2775] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 17 13:37:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:37:59.306812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f997a-9c10-4726-9265-6746b13cab98 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:37:59.320119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f997a-9c10-4726-9265-6746b13cab98 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:37:59.326726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0676c3-fde3-4ced-a759-0d1866810551 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5fff4bed294d16a0e1d5fec4991c58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:37:59.327381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0676c3-fde3-4ced-a759-0d1866810551 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:37:59.327666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0676c3-fde3-4ced-a759-0d1866810551 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:37:59.327932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0676c3-fde3-4ced-a759-0d1866810551 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:37:59.337164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0676c3-fde3-4ced-a759-0d1866810551 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:37:59.338827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0676c3-fde3-4ced-a759-0d1866810551 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:37:59.347080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1382/2776] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 17 13:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 13:38:01.654786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e33198-8669-464e-9aee-37eef21761a3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:01.656429 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c1e33198-8669-464e-9aee-37eef21761a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:01.727865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e33198-8669-464e-9aee-37eef21761a3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:01.733951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:01.734876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:01.735171 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:01.735448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] PATH_INFO: `/v3/users/df6ee253918c48aea90c6aa3eb998cc5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:01.736842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6ee253918c48aea90c6aa3eb998cc5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:01.738879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:01.791757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6ee253918c48aea90c6aa3eb998cc5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:01.792457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6ee253918c48aea90c6aa3eb998cc5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:01.793104 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6ee253918c48aea90c6aa3eb998cc5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:01.800697 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6ee253918c48aea90c6aa3eb998cc5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:01.810101 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6ee253918c48aea90c6aa3eb998cc5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:01.828017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1395/2777] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:38:01 2022] DELETE /identity/v3/users/df6ee253918c48aea90c6aa3eb998cc5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:38:01.833520 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01838097-5489-4659-bda8-459b726e2db9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:01.834028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01838097-5489-4659-bda8-459b726e2db9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:01.834164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01838097-5489-4659-bda8-459b726e2db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:01.852312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-01838097-5489-4659-bda8-459b726e2db9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:38:01.853549 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-01838097-5489-4659-bda8-459b726e2db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:01.915476 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1383/2778] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:38:01.925964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:01.928314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:01.963535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:01.993347 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ceb94-0741-4db5-a18c-d8f52d0d1843 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:01.997248 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f74ce-bdef-4fa1-bd30-3aab7df5d49b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:01.997909 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f74ce-bdef-4fa1-bd30-3aab7df5d49b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:01.998223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f74ce-bdef-4fa1-bd30-3aab7df5d49b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:01.998499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f74ce-bdef-4fa1-bd30-3aab7df5d49b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.009418 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f74ce-bdef-4fa1-bd30-3aab7df5d49b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:02.010956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f74ce-bdef-4fa1-bd30-3aab7df5d49b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:02.020889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1396/2779] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:38:02.204775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01838097-5489-4659-bda8-459b726e2db9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:02.206311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-01838097-5489-4659-bda8-459b726e2db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:02.218547 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01838097-5489-4659-bda8-459b726e2db9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:02.224209 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:02.225096 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.225374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.225693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] PATH_INFO: `/v3/projects/b930725523554152a3cfe3be04ec1362` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.226935 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b930725523554152a3cfe3be04ec1362)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:02.229992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:02.283014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b930725523554152a3cfe3be04ec1362', 'request_id': 'req-2245218b-8e7e-41a3-91c1-14f6f2f291ec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:02.289231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b930725523554152a3cfe3be04ec1362', 'request_id': 'req-2245218b-8e7e-41a3-91c1-14f6f2f291ec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:02.295675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b930725523554152a3cfe3be04ec1362', 'request_id': 'req-2245218b-8e7e-41a3-91c1-14f6f2f291ec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:02.310116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] The token cache is being invalidate because project b930725523554152a3cfe3be04ec1362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:38:02.310411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:02.311047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2245218b-8e7e-41a3-91c1-14f6f2f291ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:38:02.312991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1384/2780] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:38:02 2022] DELETE /identity/v3/projects/b930725523554152a3cfe3be04ec1362 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:38:02.318431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff5f1-f840-4093-9006-cf94cd5c968a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.318722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff5f1-f840-4093-9006-cf94cd5c968a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.318999 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff5f1-f840-4093-9006-cf94cd5c968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.337022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-544ff5f1-f840-4093-9006-cf94cd5c968a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:38:02.338226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-544ff5f1-f840-4093-9006-cf94cd5c968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:02.399483 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1397/2781] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:38:02.407489 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022ac7d-9e11-48e1-8d8d-9ccc92a3d501 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.407776 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022ac7d-9e11-48e1-8d8d-9ccc92a3d501 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.408056 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022ac7d-9e11-48e1-8d8d-9ccc92a3d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.416318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:02.428471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5022ac7d-9e11-48e1-8d8d-9ccc92a3d501 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:38:02.430900 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5022ac7d-9e11-48e1-8d8d-9ccc92a3d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:02.439223 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1385/2782] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:38:02.443564 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff5f1-f840-4093-9006-cf94cd5c968a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:02.453547 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff5f1-f840-4093-9006-cf94cd5c968a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:02.458655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8ddf-92c6-45a7-915c-e70ad9a8ce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:02.459312 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8ddf-92c6-45a7-915c-e70ad9a8ce8c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.459593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8ddf-92c6-45a7-915c-e70ad9a8ce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.459865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8ddf-92c6-45a7-915c-e70ad9a8ce8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.460768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8ddf-92c6-45a7-915c-e70ad9a8ce8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:38:02.461074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8ddf-92c6-45a7-915c-e70ad9a8ce8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:02.462731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8ddf-92c6-45a7-915c-e70ad9a8ce8c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:02.474386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1398/2783] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:38:02.478949 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022ac7d-9e11-48e1-8d8d-9ccc92a3d501 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:02.488937 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022ac7d-9e11-48e1-8d8d-9ccc92a3d501 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:02.494932 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ef635-e8e2-4fae-b079-fd6166eb1635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:02.495598 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ef635-e8e2-4fae-b079-fd6166eb1635 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.495884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ef635-e8e2-4fae-b079-fd6166eb1635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.496160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ef635-e8e2-4fae-b079-fd6166eb1635 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.496848 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ef635-e8e2-4fae-b079-fd6166eb1635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:02.498828 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ef635-e8e2-4fae-b079-fd6166eb1635 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:02.528826 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1386/2784] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:38:02 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:38:02.532867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8ddf-92c6-45a7-915c-e70ad9a8ce8c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:02.543265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8ddf-92c6-45a7-915c-e70ad9a8ce8c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:02.601756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24535608-e16e-4093-817b-826cb621a330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:02.602473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24535608-e16e-4093-817b-826cb621a330 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.602754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24535608-e16e-4093-817b-826cb621a330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.603030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24535608-e16e-4093-817b-826cb621a330 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.603722 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24535608-e16e-4093-817b-826cb621a330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:02.605997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24535608-e16e-4093-817b-826cb621a330 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:02.627431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1399/2785] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:38:02 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:38:02.631689 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ef635-e8e2-4fae-b079-fd6166eb1635 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:02.642245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ef635-e8e2-4fae-b079-fd6166eb1635 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:02.647255 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abfd69-ce85-413d-9c1a-36dfbee20cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:02.648137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abfd69-ce85-413d-9c1a-36dfbee20cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.648427 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abfd69-ce85-413d-9c1a-36dfbee20cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.648738 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abfd69-ce85-413d-9c1a-36dfbee20cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.649418 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abfd69-ce85-413d-9c1a-36dfbee20cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:02.651075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abfd69-ce85-413d-9c1a-36dfbee20cd7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:02.662305 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1387/2786] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:38:02.666452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24535608-e16e-4093-817b-826cb621a330 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:02.676807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24535608-e16e-4093-817b-826cb621a330 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:02.682707 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b278c3-a6bd-4811-ad94-606a422842d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:02.683373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b278c3-a6bd-4811-ad94-606a422842d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.683659 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b278c3-a6bd-4811-ad94-606a422842d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.683935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b278c3-a6bd-4811-ad94-606a422842d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.684696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b278c3-a6bd-4811-ad94-606a422842d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:02.686373 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b278c3-a6bd-4811-ad94-606a422842d7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:02.697816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1400/2787] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:38:02.701870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abfd69-ce85-413d-9c1a-36dfbee20cd7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:02.712518 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abfd69-ce85-413d-9c1a-36dfbee20cd7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:02.717240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a823b3-203d-437c-a0f8-e855259c3980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:02.718149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a823b3-203d-437c-a0f8-e855259c3980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.718445 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a823b3-203d-437c-a0f8-e855259c3980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.718726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a823b3-203d-437c-a0f8-e855259c3980 admin admin] PATH_INFO: `/v3/projects/442ee828e66f48429daed7cd48385680/users/a846dc3c667140e99d476aa8722c9052/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.733770 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a823b3-203d-437c-a0f8-e855259c3980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442ee828e66f48429daed7cd48385680, user_id=a846dc3c667140e99d476aa8722c9052, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:02.736508 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a823b3-203d-437c-a0f8-e855259c3980 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:02.752397 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1388/2788] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:38:02 2022] PUT /identity/v3/projects/442ee828e66f48429daed7cd48385680/users/a846dc3c667140e99d476aa8722c9052/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:38:02.758020 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14974-fda9-405f-abf4-bfd87388a32b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.758377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14974-fda9-405f-abf4-bfd87388a32b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.758657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14974-fda9-405f-abf4-bfd87388a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.776681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1df14974-fda9-405f-abf4-bfd87388a32b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:38:02.777879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1df14974-fda9-405f-abf4-bfd87388a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:02.813255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:02.842461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1401/2789] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:38:02.852400 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a823b3-203d-437c-a0f8-e855259c3980 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:02.854375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a7a823b3-203d-437c-a0f8-e855259c3980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:02.915239 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a823b3-203d-437c-a0f8-e855259c3980 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:02.919525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5e62-d251-4282-b88a-bb3e14ac17f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:02.920174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5e62-d251-4282-b88a-bb3e14ac17f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:02.920461 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5e62-d251-4282-b88a-bb3e14ac17f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:02.920741 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5e62-d251-4282-b88a-bb3e14ac17f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:02.930902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb5e62-d251-4282-b88a-bb3e14ac17f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:02.932354 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb5e62-d251-4282-b88a-bb3e14ac17f2 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:02.942042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1389/2790] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:38:06.953905 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b5f2-ce4a-4ea4-9a61-e4fe4ed94c71 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:06.954407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b5f2-ce4a-4ea4-9a61-e4fe4ed94c71 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:06.954569 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b5f2-ce4a-4ea4-9a61-e4fe4ed94c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:06.983398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5184b5f2-ce4a-4ea4-9a61-e4fe4ed94c71 None None] MFA Rules not processed for user `a846dc3c667140e99d476aa8722c9052`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:38:06.984597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5184b5f2-ce4a-4ea4-9a61-e4fe4ed94c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:07.057894 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1402/2791] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:38:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:38:07.062478 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5e62-d251-4282-b88a-bb3e14ac17f2 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:07.077116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5e62-d251-4282-b88a-bb3e14ac17f2 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:07.081748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73950f-c3f2-499f-8b60-8a19309ddb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:07.082506 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73950f-c3f2-499f-8b60-8a19309ddb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:07.082791 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73950f-c3f2-499f-8b60-8a19309ddb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:07.083070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73950f-c3f2-499f-8b60-8a19309ddb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:07.083772 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73950f-c3f2-499f-8b60-8a19309ddb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:07.086294 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73950f-c3f2-499f-8b60-8a19309ddb08 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:07.117296 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1390/2792] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:38:07 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:38:07.121390 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b5f2-ce4a-4ea4-9a61-e4fe4ed94c71 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:07.132941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b5f2-ce4a-4ea4-9a61-e4fe4ed94c71 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:07.194629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239bd3a-fa3f-4a8a-b2f9-e5a80f0ec19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:07.195364 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239bd3a-fa3f-4a8a-b2f9-e5a80f0ec19c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:07.195629 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239bd3a-fa3f-4a8a-b2f9-e5a80f0ec19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:07.195906 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239bd3a-fa3f-4a8a-b2f9-e5a80f0ec19c admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:07.196602 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239bd3a-fa3f-4a8a-b2f9-e5a80f0ec19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:07.198664 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239bd3a-fa3f-4a8a-b2f9-e5a80f0ec19c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:07.220226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1403/2793] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:38:07 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:38:07.224042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73950f-c3f2-499f-8b60-8a19309ddb08 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:07.237281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73950f-c3f2-499f-8b60-8a19309ddb08 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:07.242363 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381f5fc-fe06-42b1-83ea-855765b151b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:07.243125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381f5fc-fe06-42b1-83ea-855765b151b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:07.243477 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381f5fc-fe06-42b1-83ea-855765b151b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:07.243844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381f5fc-fe06-42b1-83ea-855765b151b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:07.244635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381f5fc-fe06-42b1-83ea-855765b151b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:07.246409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381f5fc-fe06-42b1-83ea-855765b151b0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:07.258626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1391/2794] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:38:07.263040 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239bd3a-fa3f-4a8a-b2f9-e5a80f0ec19c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:07.274154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239bd3a-fa3f-4a8a-b2f9-e5a80f0ec19c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:07.279467 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f181b27-c0a7-41ea-bb0b-51df54d86b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:07.280403 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f181b27-c0a7-41ea-bb0b-51df54d86b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:07.280703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f181b27-c0a7-41ea-bb0b-51df54d86b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:07.280978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f181b27-c0a7-41ea-bb0b-51df54d86b0e admin admin] PATH_INFO: `/v3/projects/61e836ac3e114137b94871b6f9dedb72/users/8b90a03609c440dcbc6978a8a8490db1/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:07.298992 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f181b27-c0a7-41ea-bb0b-51df54d86b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e836ac3e114137b94871b6f9dedb72, user_id=8b90a03609c440dcbc6978a8a8490db1, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:07.301726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f181b27-c0a7-41ea-bb0b-51df54d86b0e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:07.325836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1404/2795] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:38:07 2022] PUT /identity/v3/projects/61e836ac3e114137b94871b6f9dedb72/users/8b90a03609c440dcbc6978a8a8490db1/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:38:07.329982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381f5fc-fe06-42b1-83ea-855765b151b0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:07.340761 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381f5fc-fe06-42b1-83ea-855765b151b0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:07.399071 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc10ec-f9f9-47f2-93b2-cc7ed7940b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:07.399763 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc10ec-f9f9-47f2-93b2-cc7ed7940b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:07.400045 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc10ec-f9f9-47f2-93b2-cc7ed7940b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:07.400327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc10ec-f9f9-47f2-93b2-cc7ed7940b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:07.401068 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc10ec-f9f9-47f2-93b2-cc7ed7940b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:07.402799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc10ec-f9f9-47f2-93b2-cc7ed7940b95 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:07.414058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1392/2796] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:38:07.417524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f181b27-c0a7-41ea-bb0b-51df54d86b0e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:07.428406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f181b27-c0a7-41ea-bb0b-51df54d86b0e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:07.433904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b90a50-5c80-4835-953b-30aaef3c0658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:07.434877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b90a50-5c80-4835-953b-30aaef3c0658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:07.435157 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b90a50-5c80-4835-953b-30aaef3c0658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:07.435431 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b90a50-5c80-4835-953b-30aaef3c0658 admin admin] PATH_INFO: `/v3/projects/61e836ac3e114137b94871b6f9dedb72/users/8b90a03609c440dcbc6978a8a8490db1/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:07.437739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b90a50-5c80-4835-953b-30aaef3c0658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e836ac3e114137b94871b6f9dedb72, user_id=8b90a03609c440dcbc6978a8a8490db1, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:07.440765 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b90a50-5c80-4835-953b-30aaef3c0658 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:07.456321 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1405/2797] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:38:07 2022] PUT /identity/v3/projects/61e836ac3e114137b94871b6f9dedb72/users/8b90a03609c440dcbc6978a8a8490db1/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:38:12.074675 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbaa87-6841-414a-abe4-e63b4fb7f5e7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:12.075229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbaa87-6841-414a-abe4-e63b4fb7f5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:12.075229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbaa87-6841-414a-abe4-e63b4fb7f5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:12.089364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:12.107493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f5bbaa87-6841-414a-abe4-e63b4fb7f5e7 None None] MFA Rules not processed for user `8b90a03609c440dcbc6978a8a8490db1`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:38:12.108769 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f5bbaa87-6841-414a-abe4-e63b4fb7f5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:12.182505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1393/2798] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:38:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:38:12.199116 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b90a50-5c80-4835-953b-30aaef3c0658 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:12.201146 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c3b90a50-5c80-4835-953b-30aaef3c0658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:12.228727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:12.284435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b90a50-5c80-4835-953b-30aaef3c0658 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:12.290121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e4670-8906-4355-8af1-2986a1f64bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:12.290785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e4670-8906-4355-8af1-2986a1f64bf4 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:12.291065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e4670-8906-4355-8af1-2986a1f64bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:12.291337 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e4670-8906-4355-8af1-2986a1f64bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:12.353611 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e4670-8906-4355-8af1-2986a1f64bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:12.355589 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e4670-8906-4355-8af1-2986a1f64bf4 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:12.364770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1406/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:38:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:38:13.469892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f88a-8b92-4242-9565-efec2e97fee7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:13.470424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f88a-8b92-4242-9565-efec2e97fee7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:13.470628 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f88a-8b92-4242-9565-efec2e97fee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:13.489691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8217f88a-8b92-4242-9565-efec2e97fee7 None None] MFA Rules not processed for user `a846dc3c667140e99d476aa8722c9052`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:38:13.490983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8217f88a-8b92-4242-9565-efec2e97fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:13.499135 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1394/2800] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:38:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:38:22.360726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=47 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:23.484157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=34 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:43.993056 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e4670-8906-4355-8af1-2986a1f64bf4 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:44.051985 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e4670-8906-4355-8af1-2986a1f64bf4 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:44.056381 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:44.056976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:44.057596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:44.057596 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:44.059462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:44.069820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:44.071328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:44.079919 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1407/2801] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:38:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:38:54.076767 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=26 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:38:59.878820 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f88a-8b92-4242-9565-efec2e97fee7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:38:59.881035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8217f88a-8b92-4242-9565-efec2e97fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:38:59.893679 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f88a-8b92-4242-9565-efec2e97fee7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:38:59.898234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9166b3-ba01-403c-8e9f-ab87b5fc8d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:38:59.898885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9166b3-ba01-403c-8e9f-ab87b5fc8d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:38:59.899170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9166b3-ba01-403c-8e9f-ab87b5fc8d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:38:59.899446 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9166b3-ba01-403c-8e9f-ab87b5fc8d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:38:59.909289 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9166b3-ba01-403c-8e9f-ab87b5fc8d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:38:59.910786 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9166b3-ba01-403c-8e9f-ab87b5fc8d54 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:38:59.920668 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1395/2802] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:38:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:39:01.604974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:39:01.606718 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:39:01.623022 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79f44-cae3-4a16-a466-958db4a208c6 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:39:01.628601 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf38e-3fcd-4321-a5c3-a371dfd8dc36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:39:01.629255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf38e-3fcd-4321-a5c3-a371dfd8dc36 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:39:01.629539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf38e-3fcd-4321-a5c3-a371dfd8dc36 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:39:01.629834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf38e-3fcd-4321-a5c3-a371dfd8dc36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:39:01.631757 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c10bf38e-3fcd-4321-a5c3-a371dfd8dc36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:39:01.644643 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bf38e-3fcd-4321-a5c3-a371dfd8dc36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:39:01.646384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bf38e-3fcd-4321-a5c3-a371dfd8dc36 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:39:01.658243 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1408/2803] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:39:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:39:09.916257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:39:11.653577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:39:16.058245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9166b3-ba01-403c-8e9f-ab87b5fc8d54 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:39:16.060316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7d9166b3-ba01-403c-8e9f-ab87b5fc8d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:39:16.118226 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9166b3-ba01-403c-8e9f-ab87b5fc8d54 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:39:16.122672 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d83f2b-8387-4387-a71c-6acb934aea1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:39:16.123340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d83f2b-8387-4387-a71c-6acb934aea1b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:39:16.123627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d83f2b-8387-4387-a71c-6acb934aea1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:39:16.123901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d83f2b-8387-4387-a71c-6acb934aea1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:39:16.126124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-85d83f2b-8387-4387-a71c-6acb934aea1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:39:16.213161 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d83f2b-8387-4387-a71c-6acb934aea1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:39:16.214702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d83f2b-8387-4387-a71c-6acb934aea1b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:39:16.234878 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1396/2804] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:39:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:39:26.232267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=56 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:17.885339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf38e-3fcd-4321-a5c3-a371dfd8dc36 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:17.915612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf38e-3fcd-4321-a5c3-a371dfd8dc36 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:17.919654 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cefd49-c03c-43d7-b2e1-df7d423c0ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:17.920299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cefd49-c03c-43d7-b2e1-df7d423c0ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:17.920579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cefd49-c03c-43d7-b2e1-df7d423c0ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:17.920848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cefd49-c03c-43d7-b2e1-df7d423c0ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:17.922867 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-31cefd49-c03c-43d7-b2e1-df7d423c0ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:17.950865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cefd49-c03c-43d7-b2e1-df7d423c0ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:17.952328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cefd49-c03c-43d7-b2e1-df7d423c0ab4 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:17.963461 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1409/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:40:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:40:19.150902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d83f2b-8387-4387-a71c-6acb934aea1b service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:19.171857 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d83f2b-8387-4387-a71c-6acb934aea1b service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:19.175876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:19.176576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:19.176856 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:19.177132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:19.179787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:19.193595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:19.195075 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:19.206286 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1397/2806] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:40:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:40:22.892435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cefd49-c03c-43d7-b2e1-df7d423c0ab4 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:22.902054 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cefd49-c03c-43d7-b2e1-df7d423c0ab4 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:22.906805 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98921b59-90fa-43b8-962a-22501be17b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:22.907457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98921b59-90fa-43b8-962a-22501be17b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:22.907745 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98921b59-90fa-43b8-962a-22501be17b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:22.908014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98921b59-90fa-43b8-962a-22501be17b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:22.910435 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-98921b59-90fa-43b8-962a-22501be17b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:22.979087 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98921b59-90fa-43b8-962a-22501be17b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:22.980556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98921b59-90fa-43b8-962a-22501be17b0e service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:22.990730 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1410/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:40:26.234486 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:26.236016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:26.260854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39473dcf-c147-4b54-91e4-00dd58680028 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:26.265785 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:26.266740 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:26.267026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:26.267302 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] PATH_INFO: `/v3/users/b75243e37f2342c0a428d39e193e0d4b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:26.268502 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75243e37f2342c0a428d39e193e0d4b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:26.270579 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:26.323327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75243e37f2342c0a428d39e193e0d4b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.335373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75243e37f2342c0a428d39e193e0d4b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.336039 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75243e37f2342c0a428d39e193e0d4b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.345264 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75243e37f2342c0a428d39e193e0d4b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.352453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65120330-e082-4529-b53f-b8945dcf2617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75243e37f2342c0a428d39e193e0d4b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.359038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1398/2808] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:40:26 2022] DELETE /identity/v3/users/b75243e37f2342c0a428d39e193e0d4b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:40:26.551084 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98921b59-90fa-43b8-962a-22501be17b0e service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:26.562837 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98921b59-90fa-43b8-962a-22501be17b0e service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:26.625248 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:26.626254 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:26.626541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:26.626819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] PATH_INFO: `/v3/projects/17ea6f9d80f345dbb3b2bf75e0138fd3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:26.628009 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ea6f9d80f345dbb3b2bf75e0138fd3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:26.630674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:26.678423 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'request_id': 'req-cdb55929-99df-4b99-8052-74933c2ff5ce'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.685598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'request_id': 'req-cdb55929-99df-4b99-8052-74933c2ff5ce'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.693050 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:26.696486 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ea6f9d80f345dbb3b2bf75e0138fd3', 'request_id': 'req-cdb55929-99df-4b99-8052-74933c2ff5ce'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.711929 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] The token cache is being invalidate because project 17ea6f9d80f345dbb3b2bf75e0138fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:40:26.712218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.712856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cdb55929-99df-4b99-8052-74933c2ff5ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:40:26.714473 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1411/2809] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:40:26 2022] DELETE /identity/v3/projects/17ea6f9d80f345dbb3b2bf75e0138fd3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:40:26.721877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877316-7777-4b67-a37f-7f2dc332b46d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:26.722292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877316-7777-4b67-a37f-7f2dc332b46d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:26.722715 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877316-7777-4b67-a37f-7f2dc332b46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:26.742127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c6877316-7777-4b67-a37f-7f2dc332b46d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:40:26.743341 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c6877316-7777-4b67-a37f-7f2dc332b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:26.805511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1399/2810] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:40:26.813864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb954c-4ff1-4676-a3b2-67dc3f4c17a0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:26.814227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb954c-4ff1-4676-a3b2-67dc3f4c17a0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:26.814537 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb954c-4ff1-4676-a3b2-67dc3f4c17a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:26.836355 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0ddb954c-4ff1-4676-a3b2-67dc3f4c17a0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:40:26.837574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0ddb954c-4ff1-4676-a3b2-67dc3f4c17a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:26.846485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1412/2811] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:40:26.851267 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877316-7777-4b67-a37f-7f2dc332b46d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:26.861472 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877316-7777-4b67-a37f-7f2dc332b46d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:26.866923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ff544-d29a-4838-9aae-c9b51a6ea603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:26.867589 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ff544-d29a-4838-9aae-c9b51a6ea603 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:26.867875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ff544-d29a-4838-9aae-c9b51a6ea603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:26.868155 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ff544-d29a-4838-9aae-c9b51a6ea603 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:26.868876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ff544-d29a-4838-9aae-c9b51a6ea603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:40:26.869189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ff544-d29a-4838-9aae-c9b51a6ea603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:26.870863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ff544-d29a-4838-9aae-c9b51a6ea603 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:26.883073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1400/2812] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:40:26.887579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb954c-4ff1-4676-a3b2-67dc3f4c17a0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:26.897770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb954c-4ff1-4676-a3b2-67dc3f4c17a0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:26.903270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8b868-bc70-4b8a-8751-fed9b47d8242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:26.903934 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8b868-bc70-4b8a-8751-fed9b47d8242 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:26.904217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8b868-bc70-4b8a-8751-fed9b47d8242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:26.904493 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8b868-bc70-4b8a-8751-fed9b47d8242 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:26.905182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8b868-bc70-4b8a-8751-fed9b47d8242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:26.907173 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8b868-bc70-4b8a-8751-fed9b47d8242 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:26.934770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1413/2813] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:40:26 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:40:26.939105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ff544-d29a-4838-9aae-c9b51a6ea603 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:26.949471 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ff544-d29a-4838-9aae-c9b51a6ea603 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:26.973845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:27.010378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9ffbf-95af-4bbf-8a08-b728a400a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:27.011064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9ffbf-95af-4bbf-8a08-b728a400a00c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:27.011346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9ffbf-95af-4bbf-8a08-b728a400a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:27.011602 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9ffbf-95af-4bbf-8a08-b728a400a00c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:27.012290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9ffbf-95af-4bbf-8a08-b728a400a00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:27.014290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9ffbf-95af-4bbf-8a08-b728a400a00c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:27.038509 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1401/2814] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:40:26 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:40:27.041879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8b868-bc70-4b8a-8751-fed9b47d8242 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:27.053950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8b868-bc70-4b8a-8751-fed9b47d8242 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:27.059821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b3fb2-efa6-497c-807e-78ea959a835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:27.060495 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b3fb2-efa6-497c-807e-78ea959a835e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:27.060781 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b3fb2-efa6-497c-807e-78ea959a835e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:27.061064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b3fb2-efa6-497c-807e-78ea959a835e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:27.061793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b3fb2-efa6-497c-807e-78ea959a835e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:27.063502 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b3fb2-efa6-497c-807e-78ea959a835e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:27.074551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1414/2815] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:40:27.078807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9ffbf-95af-4bbf-8a08-b728a400a00c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:27.090647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9ffbf-95af-4bbf-8a08-b728a400a00c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:27.096795 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b06376-ba0c-4edf-8beb-be771e22c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:27.097465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b06376-ba0c-4edf-8beb-be771e22c7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:27.097750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b06376-ba0c-4edf-8beb-be771e22c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:27.098021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b06376-ba0c-4edf-8beb-be771e22c7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:27.099359 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b06376-ba0c-4edf-8beb-be771e22c7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:27.100982 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b06376-ba0c-4edf-8beb-be771e22c7a1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:27.111648 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1402/2816] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:40:27.116948 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b3fb2-efa6-497c-807e-78ea959a835e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:27.127997 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b3fb2-efa6-497c-807e-78ea959a835e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:27.134025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a837963-a2ee-4aea-8d24-f58cce08a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:27.134964 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a837963-a2ee-4aea-8d24-f58cce08a6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:27.135245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a837963-a2ee-4aea-8d24-f58cce08a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:27.135518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a837963-a2ee-4aea-8d24-f58cce08a6c5 admin admin] PATH_INFO: `/v3/projects/082c995275404693ae4f1f686dd8fc92/users/da449dd03e364eb0bebabd59bfe1d19c/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:27.152030 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a837963-a2ee-4aea-8d24-f58cce08a6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=082c995275404693ae4f1f686dd8fc92, user_id=da449dd03e364eb0bebabd59bfe1d19c, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:27.154834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a837963-a2ee-4aea-8d24-f58cce08a6c5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:27.171670 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1415/2817] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:40:27 2022] PUT /identity/v3/projects/082c995275404693ae4f1f686dd8fc92/users/da449dd03e364eb0bebabd59bfe1d19c/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:40:27.185592 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40774cbc-65d8-429a-9648-60e44cd85c5e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:27.185864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40774cbc-65d8-429a-9648-60e44cd85c5e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:27.186182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40774cbc-65d8-429a-9648-60e44cd85c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:27.209457 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-40774cbc-65d8-429a-9648-60e44cd85c5e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:40:27.210702 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-40774cbc-65d8-429a-9648-60e44cd85c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:27.273853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1403/2818] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:40:27.285761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a837963-a2ee-4aea-8d24-f58cce08a6c5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:27.287772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8a837963-a2ee-4aea-8d24-f58cce08a6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:27.364576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a837963-a2ee-4aea-8d24-f58cce08a6c5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:27.368417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773cda2-5a28-4a28-9e3d-24f93e6aa0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:27.369072 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773cda2-5a28-4a28-9e3d-24f93e6aa0bc service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:27.369359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773cda2-5a28-4a28-9e3d-24f93e6aa0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:27.369636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773cda2-5a28-4a28-9e3d-24f93e6aa0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:27.378884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773cda2-5a28-4a28-9e3d-24f93e6aa0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:27.380528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773cda2-5a28-4a28-9e3d-24f93e6aa0bc service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:27.397703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1416/2819] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:40:31.387789 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19770-2e9f-41d3-8c76-0e21cfcc4c5c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:31.388226 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19770-2e9f-41d3-8c76-0e21cfcc4c5c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:31.388343 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19770-2e9f-41d3-8c76-0e21cfcc4c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:31.416869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-59b19770-2e9f-41d3-8c76-0e21cfcc4c5c None None] MFA Rules not processed for user `da449dd03e364eb0bebabd59bfe1d19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:40:31.418102 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-59b19770-2e9f-41d3-8c76-0e21cfcc4c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:31.490174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1404/2820] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:40:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:40:31.504328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773cda2-5a28-4a28-9e3d-24f93e6aa0bc service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:31.506041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2773cda2-5a28-4a28-9e3d-24f93e6aa0bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:31.590259 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773cda2-5a28-4a28-9e3d-24f93e6aa0bc service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:31.595828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff95dd-55bc-4c81-8428-70bdc3a91046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:31.596563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff95dd-55bc-4c81-8428-70bdc3a91046 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:31.596913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff95dd-55bc-4c81-8428-70bdc3a91046 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:31.597246 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff95dd-55bc-4c81-8428-70bdc3a91046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:31.603553 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:31.606693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff95dd-55bc-4c81-8428-70bdc3a91046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:31.608779 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff95dd-55bc-4c81-8428-70bdc3a91046 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:31.620577 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1417/2821] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:40:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:40:34.221584 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d1616-0a83-4c5d-b41a-c6475c54b645 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:34.222149 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d1616-0a83-4c5d-b41a-c6475c54b645 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:34.222271 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d1616-0a83-4c5d-b41a-c6475c54b645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:34.241492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-991d1616-0a83-4c5d-b41a-c6475c54b645 None None] MFA Rules not processed for user `da449dd03e364eb0bebabd59bfe1d19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:40:34.242743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-991d1616-0a83-4c5d-b41a-c6475c54b645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:34.250807 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1405/2822] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:40:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:40:41.616854 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:44.235972 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:45.912675 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff95dd-55bc-4c81-8428-70bdc3a91046 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:45.914156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-87ff95dd-55bc-4c81-8428-70bdc3a91046 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:46.018979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff95dd-55bc-4c81-8428-70bdc3a91046 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:46.024904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:46.025566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:46.025856 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:46.026182 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:46.028011 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:46.040063 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:46.041683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:46.051825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1418/2823] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:40:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:40:47.850048 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d1616-0a83-4c5d-b41a-c6475c54b645 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:40:47.866513 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d1616-0a83-4c5d-b41a-c6475c54b645 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:40:47.872404 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e659-a0ad-4f70-a180-4525dd06a744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:40:47.873058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e659-a0ad-4f70-a180-4525dd06a744 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:40:47.873336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e659-a0ad-4f70-a180-4525dd06a744 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:40:47.873620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e659-a0ad-4f70-a180-4525dd06a744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:40:47.875517 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c757e659-a0ad-4f70-a180-4525dd06a744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:40:47.888130 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757e659-a0ad-4f70-a180-4525dd06a744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:40:47.889739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757e659-a0ad-4f70-a180-4525dd06a744 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:40:47.900991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1406/2824] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:40:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:40:56.047763 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=41 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:40:57.896388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:41:30.473240 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:41:30.474971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:41:30.487990 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ba83-a0da-4c93-b07d-96775dfba143 service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:41:30.492764 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333271a2-e62f-4a06-a4fb-f1001168c558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:41:30.493409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333271a2-e62f-4a06-a4fb-f1001168c558 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:41:30.493686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333271a2-e62f-4a06-a4fb-f1001168c558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:41:30.493956 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333271a2-e62f-4a06-a4fb-f1001168c558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:41:30.496122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-333271a2-e62f-4a06-a4fb-f1001168c558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:41:30.506380 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333271a2-e62f-4a06-a4fb-f1001168c558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:41:30.507782 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333271a2-e62f-4a06-a4fb-f1001168c558 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:41:30.516457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1419/2825] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:41:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:41:30.625601 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e659-a0ad-4f70-a180-4525dd06a744 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:41:30.636924 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e659-a0ad-4f70-a180-4525dd06a744 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:41:30.641304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd2089-85ef-4a60-a46d-fe5387934cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:41:30.642033 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd2089-85ef-4a60-a46d-fe5387934cfa service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:41:30.642665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd2089-85ef-4a60-a46d-fe5387934cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:41:30.642904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd2089-85ef-4a60-a46d-fe5387934cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:41:30.644891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-50bd2089-85ef-4a60-a46d-fe5387934cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:41:30.656450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd2089-85ef-4a60-a46d-fe5387934cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:41:30.658316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd2089-85ef-4a60-a46d-fe5387934cfa service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:41:30.667691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1407/2826] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:41:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:41:30.744064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333271a2-e62f-4a06-a4fb-f1001168c558 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:41:30.753165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333271a2-e62f-4a06-a4fb-f1001168c558 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:41:30.758233 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c616a-925d-465f-9910-f770bd1ff756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:41:30.758791 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c616a-925d-465f-9910-f770bd1ff756 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:41:30.759071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c616a-925d-465f-9910-f770bd1ff756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:41:30.759343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c616a-925d-465f-9910-f770bd1ff756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:41:30.761391 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-718c616a-925d-465f-9910-f770bd1ff756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:41:30.778630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c616a-925d-465f-9910-f770bd1ff756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:41:30.780333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c616a-925d-465f-9910-f770bd1ff756 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:41:30.791953 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1420/2827] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:41:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:41:40.664171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:41:40.786470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=12 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:17.851373 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb732f6-e844-4160-a4b5-b5d2be35ca47 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:42:17.851907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb732f6-e844-4160-a4b5-b5d2be35ca47 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:42:17.851907 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb732f6-e844-4160-a4b5-b5d2be35ca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:42:17.870899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7cb732f6-e844-4160-a4b5-b5d2be35ca47 None None] MFA Rules not processed for user `da449dd03e364eb0bebabd59bfe1d19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:42:17.872167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7cb732f6-e844-4160-a4b5-b5d2be35ca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:42:17.879556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1408/2828] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:42:18.199855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c616a-925d-465f-9910-f770bd1ff756 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:42:18.208673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c616a-925d-465f-9910-f770bd1ff756 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:42:18.212651 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbf21d-590d-49f5-b802-e05a1dfa178b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:42:18.213303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbf21d-590d-49f5-b802-e05a1dfa178b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:42:18.213586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbf21d-590d-49f5-b802-e05a1dfa178b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:42:18.213844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbf21d-590d-49f5-b802-e05a1dfa178b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:42:18.215778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a6bbf21d-590d-49f5-b802-e05a1dfa178b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:42:18.226447 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbf21d-590d-49f5-b802-e05a1dfa178b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:42:18.227971 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbf21d-590d-49f5-b802-e05a1dfa178b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:42:18.236778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1421/2829] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:42:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:42:18.568158 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb732f6-e844-4160-a4b5-b5d2be35ca47 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:42:18.569756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7cb732f6-e844-4160-a4b5-b5d2be35ca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:42:18.585444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb732f6-e844-4160-a4b5-b5d2be35ca47 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:42:18.590619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:42:18.591280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:42:18.591562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:42:18.591839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:42:18.593683 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:42:18.606118 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:42:18.607718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:42:18.618872 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1409/2830] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:42:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:42:28.232835 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:42:28.613800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=9 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:20.831164 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbf21d-590d-49f5-b802-e05a1dfa178b service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:43:20.844515 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbf21d-590d-49f5-b802-e05a1dfa178b service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:43:20.849098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f12adb-fa73-40cf-ac6f-64a646fd2c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:43:20.849756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f12adb-fa73-40cf-ac6f-64a646fd2c5c service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:20.850023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f12adb-fa73-40cf-ac6f-64a646fd2c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:20.850330 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f12adb-fa73-40cf-ac6f-64a646fd2c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:20.852382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-33f12adb-fa73-40cf-ac6f-64a646fd2c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:20.914904 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f12adb-fa73-40cf-ac6f-64a646fd2c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:43:20.916309 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f12adb-fa73-40cf-ac6f-64a646fd2c5c service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:43:20.926385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1422/2831] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:43:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:43:22.102025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:43:22.103533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:22.125690 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643063cf-66a8-4490-afc1-c6a8c8670955 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:43:22.132116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdad4ed-1108-4951-896d-2bebefc6a4ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:43:22.132798 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdad4ed-1108-4951-896d-2bebefc6a4ce service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:22.133088 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdad4ed-1108-4951-896d-2bebefc6a4ce service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:22.133370 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdad4ed-1108-4951-896d-2bebefc6a4ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:22.135287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-efdad4ed-1108-4951-896d-2bebefc6a4ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:22.148454 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdad4ed-1108-4951-896d-2bebefc6a4ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:43:22.150116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdad4ed-1108-4951-896d-2bebefc6a4ce service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:43:22.162262 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1410/2832] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:43:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:43:26.015361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f12adb-fa73-40cf-ac6f-64a646fd2c5c service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:43:26.024785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f12adb-fa73-40cf-ac6f-64a646fd2c5c service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:43:26.028913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:43:26.029524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:26.029807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:26.030074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:26.032126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:26.044720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:43:26.046156 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:43:26.056074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1423/2833] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:43:28.960550 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdad4ed-1108-4951-896d-2bebefc6a4ce service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:43:28.971812 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdad4ed-1108-4951-896d-2bebefc6a4ce service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:43:28.976842 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dd895-b00f-4c31-af50-7d910a3f7ae2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:43:28.977495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dd895-b00f-4c31-af50-7d910a3f7ae2 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:28.977778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dd895-b00f-4c31-af50-7d910a3f7ae2 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:28.978054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dd895-b00f-4c31-af50-7d910a3f7ae2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:28.982028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aa3dd895-b00f-4c31-af50-7d910a3f7ae2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:28.994063 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dd895-b00f-4c31-af50-7d910a3f7ae2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:43:28.995722 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dd895-b00f-4c31-af50-7d910a3f7ae2 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:43:29.007113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1411/2834] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:43:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:43:32.484821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:43:32.487043 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:32.503551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680ce95-0144-4c7e-af25-19c5a7620eac service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:43:32.509167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:43:32.510064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:32.510386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:32.510661 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] PATH_INFO: `/v3/users/a846dc3c667140e99d476aa8722c9052` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:32.512013 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a846dc3c667140e99d476aa8722c9052)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:43:32.514042 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:43:32.566991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a846dc3c667140e99d476aa8722c9052'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.567636 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a846dc3c667140e99d476aa8722c9052'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.568245 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a846dc3c667140e99d476aa8722c9052'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.575190 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a846dc3c667140e99d476aa8722c9052'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.584907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a846dc3c667140e99d476aa8722c9052'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.608424 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1424/2835] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:43:32 2022] DELETE /identity/v3/users/a846dc3c667140e99d476aa8722c9052 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:43:32.793528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dd895-b00f-4c31-af50-7d910a3f7ae2 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:43:32.806899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dd895-b00f-4c31-af50-7d910a3f7ae2 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:43:32.868864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:43:32.869750 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:32.870029 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:32.870333 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] PATH_INFO: `/v3/projects/442ee828e66f48429daed7cd48385680` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:32.871516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=442ee828e66f48429daed7cd48385680)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:43:32.873425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:43:32.930483 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442ee828e66f48429daed7cd48385680', 'request_id': 'req-0027bdeb-a57b-424a-acf4-6010641bbbb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.936174 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442ee828e66f48429daed7cd48385680', 'request_id': 'req-0027bdeb-a57b-424a-acf4-6010641bbbb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.942877 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442ee828e66f48429daed7cd48385680', 'request_id': 'req-0027bdeb-a57b-424a-acf4-6010641bbbb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.957207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] The token cache is being invalidate because project 442ee828e66f48429daed7cd48385680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:43:32.957492 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.958153 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:32.959759 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1412/2836] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:43:32 2022] DELETE /identity/v3/projects/442ee828e66f48429daed7cd48385680 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:43:32.963864 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:43:32.965362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:32.979560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f742a-b8c7-4845-bf4d-1c0cf86d8731 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:43:33.033082 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:33.040576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:43:33.041840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:33.042166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:33.042500 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] PATH_INFO: `/v3/users/8b90a03609c440dcbc6978a8a8490db1` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:33.044027 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b90a03609c440dcbc6978a8a8490db1)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:43:33.046229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:43:33.096656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b90a03609c440dcbc6978a8a8490db1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.097642 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b90a03609c440dcbc6978a8a8490db1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.098382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b90a03609c440dcbc6978a8a8490db1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.106658 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b90a03609c440dcbc6978a8a8490db1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.116528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b90a03609c440dcbc6978a8a8490db1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.136649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1425/2837] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:43:32 2022] DELETE /identity/v3/users/8b90a03609c440dcbc6978a8a8490db1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:43:33.332941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:43:33.334529 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:33.349384 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027bdeb-a57b-424a-acf4-6010641bbbb5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:43:33.414906 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:43:33.415800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:33.416078 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:33.416970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] PATH_INFO: `/v3/projects/61e836ac3e114137b94871b6f9dedb72` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:33.418329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e836ac3e114137b94871b6f9dedb72)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:43:33.421624 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:43:33.428168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:33.478447 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e836ac3e114137b94871b6f9dedb72', 'request_id': 'req-f113359c-e27c-4619-bf80-75314e9b9d2f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.484326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e836ac3e114137b94871b6f9dedb72', 'request_id': 'req-f113359c-e27c-4619-bf80-75314e9b9d2f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.490646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e836ac3e114137b94871b6f9dedb72', 'request_id': 'req-f113359c-e27c-4619-bf80-75314e9b9d2f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.504859 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] The token cache is being invalidate because project 61e836ac3e114137b94871b6f9dedb72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:43:33.505167 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.505936 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f113359c-e27c-4619-bf80-75314e9b9d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:43:33.507567 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1413/2838] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:43:33 2022] DELETE /identity/v3/projects/61e836ac3e114137b94871b6f9dedb72 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:43:43.130585 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:43.501671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:47.338367 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:43:47.340024 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:47.435044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c14ed-39c8-41c7-bd3e-7ad02615f6d5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:43:47.487586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:43:47.488238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:47.488514 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:47.488788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:47.490845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:47.500372 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:43:47.501839 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:43:47.510065 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1426/2839] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:43:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:43:57.506720 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=55 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:43:58.209652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507e2b-787a-492e-a8ba-fe7d358dfb58 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:43:58.210168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507e2b-787a-492e-a8ba-fe7d358dfb58 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:43:58.210268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507e2b-787a-492e-a8ba-fe7d358dfb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:43:58.230065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-65507e2b-787a-492e-a8ba-fe7d358dfb58 None None] MFA Rules not processed for user `da449dd03e364eb0bebabd59bfe1d19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:43:58.231287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-65507e2b-787a-492e-a8ba-fe7d358dfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:43:58.291364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1414/2840] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:43:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:44:08.283943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=25 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:28.376333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:45:28.377946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:28.460832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eff3f-a58f-4913-b3a7-cb7d2973266d service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:45:28.464817 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0901f3-ccee-4c07-bcad-cbdc83fea84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:45:28.465470 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0901f3-ccee-4c07-bcad-cbdc83fea84d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:45:28.465755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0901f3-ccee-4c07-bcad-cbdc83fea84d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:45:28.466031 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0901f3-ccee-4c07-bcad-cbdc83fea84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:45:28.467946 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7d0901f3-ccee-4c07-bcad-cbdc83fea84d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:28.563655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0901f3-ccee-4c07-bcad-cbdc83fea84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:45:28.565150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0901f3-ccee-4c07-bcad-cbdc83fea84d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:45:28.587149 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1427/2841] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:45:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:45:32.040718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507e2b-787a-492e-a8ba-fe7d358dfb58 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:45:32.043395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-65507e2b-787a-492e-a8ba-fe7d358dfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:32.060017 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507e2b-787a-492e-a8ba-fe7d358dfb58 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:45:32.064787 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1736-5786-4e4b-95ca-4e212ffb1e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:45:32.065501 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1736-5786-4e4b-95ca-4e212ffb1e8b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:45:32.065781 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1736-5786-4e4b-95ca-4e212ffb1e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:45:32.066031 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1736-5786-4e4b-95ca-4e212ffb1e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:45:32.068325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-03fe1736-5786-4e4b-95ca-4e212ffb1e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:32.080108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe1736-5786-4e4b-95ca-4e212ffb1e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:45:32.081638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe1736-5786-4e4b-95ca-4e212ffb1e8b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:45:32.090657 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1415/2842] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:45:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:45:36.503936 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0901f3-ccee-4c07-bcad-cbdc83fea84d service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:45:36.516988 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0901f3-ccee-4c07-bcad-cbdc83fea84d service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:45:36.521696 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:45:36.522448 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:45:36.522761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:45:36.523034 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:45:36.525035 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:36.540345 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:45:36.541743 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:45:36.552841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1428/2843] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:45:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:45:42.086938 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:43.996883 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3e82-effb-4d24-bd71-64c4a2fa19c6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:45:43.997564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3e82-effb-4d24-bd71-64c4a2fa19c6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:45:43.997916 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf3e82-effb-4d24-bd71-64c4a2fa19c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:45:44.020684 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4adf3e82-effb-4d24-bd71-64c4a2fa19c6 None None] MFA Rules not processed for user `da449dd03e364eb0bebabd59bfe1d19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:45:44.022308 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4adf3e82-effb-4d24-bd71-64c4a2fa19c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:44.033016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1416/2844] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:45:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:45:46.547818 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=81 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:45:52.584786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:45:52.586685 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:52.669641 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12b96c-b37f-452b-b15d-92cf3dd60ae0 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:45:52.678879 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1218c97-7dd4-4e72-9907-f76d09305ecf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:45:52.679823 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1218c97-7dd4-4e72-9907-f76d09305ecf service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:45:52.680227 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1218c97-7dd4-4e72-9907-f76d09305ecf service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:45:52.680679 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1218c97-7dd4-4e72-9907-f76d09305ecf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:45:52.683549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b1218c97-7dd4-4e72-9907-f76d09305ecf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:52.698841 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1218c97-7dd4-4e72-9907-f76d09305ecf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:45:52.700460 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1218c97-7dd4-4e72-9907-f76d09305ecf service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:45:52.710942 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1429/2845] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:45:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:45:53.294997 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3e82-effb-4d24-bd71-64c4a2fa19c6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:45:53.296629 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4adf3e82-effb-4d24-bd71-64c4a2fa19c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:53.318899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf3e82-effb-4d24-bd71-64c4a2fa19c6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:45:53.324723 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c33a7-4f9c-4153-8c14-88c45aaf40c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:45:53.325482 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c33a7-4f9c-4153-8c14-88c45aaf40c8 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:45:53.325719 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c33a7-4f9c-4153-8c14-88c45aaf40c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:45:53.326020 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c33a7-4f9c-4153-8c14-88c45aaf40c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:45:53.327845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-009c33a7-4f9c-4153-8c14-88c45aaf40c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:53.340829 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c33a7-4f9c-4153-8c14-88c45aaf40c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:45:53.342562 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c33a7-4f9c-4153-8c14-88c45aaf40c8 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:45:53.354607 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1417/2846] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:45:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:45:56.438762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1218c97-7dd4-4e72-9907-f76d09305ecf service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:45:56.451838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1218c97-7dd4-4e72-9907-f76d09305ecf service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:45:56.458712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c8528-34c3-456a-950a-59ee32c14d8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a967d14a7243068a016b4677e47234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:45:56.459374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c8528-34c3-456a-950a-59ee32c14d8e service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:45:56.459656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c8528-34c3-456a-950a-59ee32c14d8e service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:45:56.460539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c8528-34c3-456a-950a-59ee32c14d8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:45:56.462632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d58c8528-34c3-456a-950a-59ee32c14d8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:45:56.476586 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c8528-34c3-456a-950a-59ee32c14d8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:45:56.478689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c8528-34c3-456a-950a-59ee32c14d8e service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:45:56.490806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1430/2847] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:45:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:46:03.349620 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=9 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:46:06.485691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=38 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:30.308575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910cf82-d3ac-449e-bc6f-d49d0e2c3aa1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:30.309173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910cf82-d3ac-449e-bc6f-d49d0e2c3aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:30.309173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910cf82-d3ac-449e-bc6f-d49d0e2c3aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:30.358745 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0910cf82-d3ac-449e-bc6f-d49d0e2c3aa1 None None] MFA Rules not processed for user `688ecef411094633927ffd663ffa1818`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:30.359959 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0910cf82-d3ac-449e-bc6f-d49d0e2c3aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:30.367018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1418/2848] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Jun 17 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:30.373681 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c8528-34c3-456a-950a-59ee32c14d8e service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:30.383303 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c8528-34c3-456a-950a-59ee32c14d8e service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:30.387223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e2cf3-a775-4efb-93fa-15fde2f94ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:30.387880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e2cf3-a775-4efb-93fa-15fde2f94ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:30.388166 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e2cf3-a775-4efb-93fa-15fde2f94ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:30.388450 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e2cf3-a775-4efb-93fa-15fde2f94ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:30.390543 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6b4e2cf3-a775-4efb-93fa-15fde2f94ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:30.483417 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e2cf3-a775-4efb-93fa-15fde2f94ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:30.484826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e2cf3-a775-4efb-93fa-15fde2f94ce7 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:30.506361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1431/2849] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:47:33.705985 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910cf82-d3ac-449e-bc6f-d49d0e2c3aa1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:33.707999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0910cf82-d3ac-449e-bc6f-d49d0e2c3aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:33.727288 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910cf82-d3ac-449e-bc6f-d49d0e2c3aa1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:33.732266 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:33.733157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:33.733439 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:33.733711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] PATH_INFO: `/v3/users/da449dd03e364eb0bebabd59bfe1d19c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:33.734965 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da449dd03e364eb0bebabd59bfe1d19c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:33.736925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:33.783929 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da449dd03e364eb0bebabd59bfe1d19c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:33.795905 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da449dd03e364eb0bebabd59bfe1d19c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:33.796644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da449dd03e364eb0bebabd59bfe1d19c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:33.807507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da449dd03e364eb0bebabd59bfe1d19c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:33.814638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b8a43d4-3016-4b21-b600-76814a985260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da449dd03e364eb0bebabd59bfe1d19c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:33.820693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1419/2850] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:47:33 2022] DELETE /identity/v3/users/da449dd03e364eb0bebabd59bfe1d19c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:34.266070 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e2cf3-a775-4efb-93fa-15fde2f94ce7 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:34.276709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e2cf3-a775-4efb-93fa-15fde2f94ce7 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:34.337608 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:34.338549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.338833 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.339140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] PATH_INFO: `/v3/projects/082c995275404693ae4f1f686dd8fc92` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.340451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082c995275404693ae4f1f686dd8fc92)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:34.342725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:34.392795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082c995275404693ae4f1f686dd8fc92', 'request_id': 'req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:34.399122 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082c995275404693ae4f1f686dd8fc92', 'request_id': 'req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:34.408960 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082c995275404693ae4f1f686dd8fc92', 'request_id': 'req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:34.414165 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:34.422369 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] The token cache is being invalidate because project 082c995275404693ae4f1f686dd8fc92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:47:34.422762 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:34.423683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e94d245a-a3e4-45ae-b041-9ec60a60f7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:34.425440 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1432/2851] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:47:34 2022] DELETE /identity/v3/projects/082c995275404693ae4f1f686dd8fc92 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:34.430338 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b5c4-af54-4b3d-bf6e-edca70ead68b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.430631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b5c4-af54-4b3d-bf6e-edca70ead68b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.430910 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b5c4-af54-4b3d-bf6e-edca70ead68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.479514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f986b5c4-af54-4b3d-bf6e-edca70ead68b None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:34.480720 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f986b5c4-af54-4b3d-bf6e-edca70ead68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:34.541328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1420/2852] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:34.549322 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2be07-6d1c-473a-a23a-29601490dc82 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.549644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2be07-6d1c-473a-a23a-29601490dc82 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.549927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2be07-6d1c-473a-a23a-29601490dc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.569507 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-64b2be07-6d1c-473a-a23a-29601490dc82 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:34.570747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-64b2be07-6d1c-473a-a23a-29601490dc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:34.579222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1433/2853] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:34.583388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b5c4-af54-4b3d-bf6e-edca70ead68b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:34.593717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b5c4-af54-4b3d-bf6e-edca70ead68b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:34.599001 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00c217-235f-4e70-8995-fecd90231643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:34.599667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00c217-235f-4e70-8995-fecd90231643 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.599951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00c217-235f-4e70-8995-fecd90231643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.600226 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00c217-235f-4e70-8995-fecd90231643 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.600988 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00c217-235f-4e70-8995-fecd90231643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:47:34.601297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00c217-235f-4e70-8995-fecd90231643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:34.603309 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00c217-235f-4e70-8995-fecd90231643 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:34.615893 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1421/2854] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:47:34.620177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2be07-6d1c-473a-a23a-29601490dc82 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:34.630731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2be07-6d1c-473a-a23a-29601490dc82 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:34.637162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af0e68-9532-4c29-8b29-c65ab44c9ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:34.638121 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af0e68-9532-4c29-8b29-c65ab44c9ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.638650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af0e68-9532-4c29-8b29-c65ab44c9ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.639002 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af0e68-9532-4c29-8b29-c65ab44c9ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.639709 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af0e68-9532-4c29-8b29-c65ab44c9ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:34.641649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af0e68-9532-4c29-8b29-c65ab44c9ad6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:34.679970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1434/2855] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:47:34 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:47:34.684314 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00c217-235f-4e70-8995-fecd90231643 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:34.694891 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00c217-235f-4e70-8995-fecd90231643 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:34.699884 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:34.752973 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc79fa-6f82-48d0-8978-84555e1623ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:34.753671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc79fa-6f82-48d0-8978-84555e1623ca admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.753944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc79fa-6f82-48d0-8978-84555e1623ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.754226 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc79fa-6f82-48d0-8978-84555e1623ca admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.754920 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc79fa-6f82-48d0-8978-84555e1623ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:34.756875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc79fa-6f82-48d0-8978-84555e1623ca admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:34.780695 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1422/2856] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:47:34 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:34.784950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af0e68-9532-4c29-8b29-c65ab44c9ad6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:34.796459 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af0e68-9532-4c29-8b29-c65ab44c9ad6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:34.801512 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830cb3f-24ad-477f-8530-a536b094bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:34.802228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830cb3f-24ad-477f-8530-a536b094bd26 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.802561 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830cb3f-24ad-477f-8530-a536b094bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.802840 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830cb3f-24ad-477f-8530-a536b094bd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.803561 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830cb3f-24ad-477f-8530-a536b094bd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:34.805218 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830cb3f-24ad-477f-8530-a536b094bd26 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:34.815528 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1435/2857] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:34.819530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc79fa-6f82-48d0-8978-84555e1623ca admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:34.830621 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc79fa-6f82-48d0-8978-84555e1623ca admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:34.837083 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c99e38-8ed3-4928-bd5c-c762773ceb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:34.837753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99e38-8ed3-4928-bd5c-c762773ceb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.838028 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99e38-8ed3-4928-bd5c-c762773ceb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.838329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99e38-8ed3-4928-bd5c-c762773ceb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.839052 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c99e38-8ed3-4928-bd5c-c762773ceb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:34.840652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c99e38-8ed3-4928-bd5c-c762773ceb95 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:34.851643 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1423/2858] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:34.856284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830cb3f-24ad-477f-8530-a536b094bd26 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:34.867877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830cb3f-24ad-477f-8530-a536b094bd26 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:34.874499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b010-4a82-4149-86c8-d90068320723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:34.875262 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b010-4a82-4149-86c8-d90068320723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.875541 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b010-4a82-4149-86c8-d90068320723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.875822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b010-4a82-4149-86c8-d90068320723 admin admin] PATH_INFO: `/v3/projects/8a2f439651db4fcea62acc37f7e38009/users/73291f97b8d3413388916d4b09cc63ca/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.892556 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39b010-4a82-4149-86c8-d90068320723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2f439651db4fcea62acc37f7e38009, user_id=73291f97b8d3413388916d4b09cc63ca, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:34.895544 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39b010-4a82-4149-86c8-d90068320723 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:34.910848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1436/2859] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:34 2022] PUT /identity/v3/projects/8a2f439651db4fcea62acc37f7e38009/users/73291f97b8d3413388916d4b09cc63ca/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:34.922357 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494deb-fec6-4183-827c-d204002a4850 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:34.922647 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494deb-fec6-4183-827c-d204002a4850 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:34.922991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db494deb-fec6-4183-827c-d204002a4850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:34.952841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-db494deb-fec6-4183-827c-d204002a4850 None None] MFA Rules not processed for user `73291f97b8d3413388916d4b09cc63ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:34.954072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-db494deb-fec6-4183-827c-d204002a4850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:35.021189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1424/2860] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:35.025619 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b010-4a82-4149-86c8-d90068320723 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:35.091978 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b010-4a82-4149-86c8-d90068320723 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:35.097784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f721d80-2ae0-4be4-9f61-f2d9255f6b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:35.098471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f721d80-2ae0-4be4-9f61-f2d9255f6b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:35.098792 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f721d80-2ae0-4be4-9f61-f2d9255f6b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:35.099064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f721d80-2ae0-4be4-9f61-f2d9255f6b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:35.099750 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f721d80-2ae0-4be4-9f61-f2d9255f6b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:35.101705 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f721d80-2ae0-4be4-9f61-f2d9255f6b72 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:35.130727 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1437/2861] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:47:35 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:35.134783 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494deb-fec6-4183-827c-d204002a4850 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:35.147490 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db494deb-fec6-4183-827c-d204002a4850 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:35.215304 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273eaf8-668c-4dad-8f9c-5a383d0641cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:35.216042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273eaf8-668c-4dad-8f9c-5a383d0641cd admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:35.216325 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273eaf8-668c-4dad-8f9c-5a383d0641cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:35.216633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273eaf8-668c-4dad-8f9c-5a383d0641cd admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:35.217328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273eaf8-668c-4dad-8f9c-5a383d0641cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:35.219365 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273eaf8-668c-4dad-8f9c-5a383d0641cd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:35.245073 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1425/2862] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:47:35 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:35.249140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f721d80-2ae0-4be4-9f61-f2d9255f6b72 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:35.259746 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f721d80-2ae0-4be4-9f61-f2d9255f6b72 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:35.265277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c9555-3931-4a5e-b360-afc0f7142045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:35.265932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9555-3931-4a5e-b360-afc0f7142045 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:35.266250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9555-3931-4a5e-b360-afc0f7142045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:35.266845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9555-3931-4a5e-b360-afc0f7142045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:35.267220 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c9555-3931-4a5e-b360-afc0f7142045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:35.268861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c9555-3931-4a5e-b360-afc0f7142045 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:35.279855 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1438/2863] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:35.284190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273eaf8-668c-4dad-8f9c-5a383d0641cd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:35.294290 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273eaf8-668c-4dad-8f9c-5a383d0641cd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:35.299327 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacecf61-013f-4029-a7c7-5117335c1de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:35.300211 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacecf61-013f-4029-a7c7-5117335c1de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:35.300494 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacecf61-013f-4029-a7c7-5117335c1de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:35.300789 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacecf61-013f-4029-a7c7-5117335c1de5 admin admin] PATH_INFO: `/v3/projects/3f08fdca5f2b4dca89d94c62bdf7dadc/users/09fc4f93566b46dbb8fbbdf5b9667f98/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:35.303098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:35.317909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacecf61-013f-4029-a7c7-5117335c1de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f08fdca5f2b4dca89d94c62bdf7dadc, user_id=09fc4f93566b46dbb8fbbdf5b9667f98, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:35.320634 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacecf61-013f-4029-a7c7-5117335c1de5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:35.335008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1426/2864] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:35 2022] PUT /identity/v3/projects/3f08fdca5f2b4dca89d94c62bdf7dadc/users/09fc4f93566b46dbb8fbbdf5b9667f98/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:35.339180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c9555-3931-4a5e-b360-afc0f7142045 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:35.349555 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c9555-3931-4a5e-b360-afc0f7142045 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:35.404213 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:35.411314 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63846cf9-0ecf-41f1-b595-da1260606894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:35.412025 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63846cf9-0ecf-41f1-b595-da1260606894 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:35.412506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63846cf9-0ecf-41f1-b595-da1260606894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:35.413021 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63846cf9-0ecf-41f1-b595-da1260606894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:35.413795 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63846cf9-0ecf-41f1-b595-da1260606894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:35.415598 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63846cf9-0ecf-41f1-b595-da1260606894 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:35.425593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1439/2865] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:35.430009 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacecf61-013f-4029-a7c7-5117335c1de5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:35.441712 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacecf61-013f-4029-a7c7-5117335c1de5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:35.447098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cbdaa-72a1-4339-b0dd-fb078ac2c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:35.448004 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cbdaa-72a1-4339-b0dd-fb078ac2c2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:35.448281 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cbdaa-72a1-4339-b0dd-fb078ac2c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:35.448561 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cbdaa-72a1-4339-b0dd-fb078ac2c2f1 admin admin] PATH_INFO: `/v3/projects/3f08fdca5f2b4dca89d94c62bdf7dadc/users/09fc4f93566b46dbb8fbbdf5b9667f98/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:35.451145 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cbdaa-72a1-4339-b0dd-fb078ac2c2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f08fdca5f2b4dca89d94c62bdf7dadc, user_id=09fc4f93566b46dbb8fbbdf5b9667f98, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:35.453846 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cbdaa-72a1-4339-b0dd-fb078ac2c2f1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:35.464227 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1427/2866] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:35 2022] PUT /identity/v3/projects/3f08fdca5f2b4dca89d94c62bdf7dadc/users/09fc4f93566b46dbb8fbbdf5b9667f98/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:35.474567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac5395-6b24-4249-9ddb-79aa48d82bd9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:35.474858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac5395-6b24-4249-9ddb-79aa48d82bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:35.475148 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac5395-6b24-4249-9ddb-79aa48d82bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:35.503233 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-26ac5395-6b24-4249-9ddb-79aa48d82bd9 None None] MFA Rules not processed for user `09fc4f93566b46dbb8fbbdf5b9667f98`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:35.504457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-26ac5395-6b24-4249-9ddb-79aa48d82bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:35.580595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1440/2867] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:35.592810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cbdaa-72a1-4339-b0dd-fb078ac2c2f1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:35.594727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-174cbdaa-72a1-4339-b0dd-fb078ac2c2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:35.654652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cbdaa-72a1-4339-b0dd-fb078ac2c2f1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:35.659410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a95e-c117-4c48-83d6-600ae29319af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:35.660079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a95e-c117-4c48-83d6-600ae29319af service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:35.660491 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a95e-c117-4c48-83d6-600ae29319af service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:35.660773 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a95e-c117-4c48-83d6-600ae29319af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:35.674954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6a95e-c117-4c48-83d6-600ae29319af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:35.676493 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6a95e-c117-4c48-83d6-600ae29319af service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:35.686966 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1428/2868] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:47:35.780491 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac5395-6b24-4249-9ddb-79aa48d82bd9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:35.791400 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac5395-6b24-4249-9ddb-79aa48d82bd9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:35.795620 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330724c-6410-409b-9896-bf44ba8eeee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:35.796288 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330724c-6410-409b-9896-bf44ba8eeee2 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:35.796570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330724c-6410-409b-9896-bf44ba8eeee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:35.796844 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330724c-6410-409b-9896-bf44ba8eeee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:35.857951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330724c-6410-409b-9896-bf44ba8eeee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:35.859505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330724c-6410-409b-9896-bf44ba8eeee2 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:35.869053 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1441/2869] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:47:45.682162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=38,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:45.864686 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=65 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:47.341901 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a95e-c117-4c48-83d6-600ae29319af service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:47.417806 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a95e-c117-4c48-83d6-600ae29319af service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:47.423391 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:47.424299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:47.424585 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:47.424864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] PATH_INFO: `/v3/users/73291f97b8d3413388916d4b09cc63ca` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:47.426125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73291f97b8d3413388916d4b09cc63ca)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:47.428092 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:47.483292 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73291f97b8d3413388916d4b09cc63ca'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:47.495377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73291f97b8d3413388916d4b09cc63ca'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:47.496084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73291f97b8d3413388916d4b09cc63ca'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:47.505399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73291f97b8d3413388916d4b09cc63ca'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:47.512329 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-089488c9-13b0-4925-bc1b-73dea41c36f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73291f97b8d3413388916d4b09cc63ca'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:47.518393 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1429/2870] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:47:47 2022] DELETE /identity/v3/users/73291f97b8d3413388916d4b09cc63ca => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:47.522996 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700952a-a3cf-4392-96e5-4189d4f9c20e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:47.523482 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700952a-a3cf-4392-96e5-4189d4f9c20e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:47.523584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700952a-a3cf-4392-96e5-4189d4f9c20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:47.542787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6700952a-a3cf-4392-96e5-4189d4f9c20e None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:47.543975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6700952a-a3cf-4392-96e5-4189d4f9c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:47.605217 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1442/2871] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:47:47.616544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008559f-09f7-44ae-9743-91dc054976c6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:47.616836 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008559f-09f7-44ae-9743-91dc054976c6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:47.617119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008559f-09f7-44ae-9743-91dc054976c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:47.647369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0008559f-09f7-44ae-9743-91dc054976c6 None None] MFA Rules not processed for user `688ecef411094633927ffd663ffa1818`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:47.648545 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0008559f-09f7-44ae-9743-91dc054976c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:47.715220 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1430/2872] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Jun 17 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:47.721687 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700952a-a3cf-4392-96e5-4189d4f9c20e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:47.732559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700952a-a3cf-4392-96e5-4189d4f9c20e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:47.736981 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1466d-6459-4808-938f-6645efd53f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:47.737637 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1466d-6459-4808-938f-6645efd53f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:47.737921 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1466d-6459-4808-938f-6645efd53f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:47.738237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1466d-6459-4808-938f-6645efd53f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:47.748995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1466d-6459-4808-938f-6645efd53f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:47.750558 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1466d-6459-4808-938f-6645efd53f1e service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:47.760535 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1443/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:47:48.036732 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008559f-09f7-44ae-9743-91dc054976c6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:48.038311 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0008559f-09f7-44ae-9743-91dc054976c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:48.054238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008559f-09f7-44ae-9743-91dc054976c6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:48.059273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:48.060616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:48.060845 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:48.061104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] PATH_INFO: `/v3/projects/8a2f439651db4fcea62acc37f7e38009` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:48.062443 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2f439651db4fcea62acc37f7e38009)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:48.065284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:48.083216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:48.118188 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2f439651db4fcea62acc37f7e38009', 'request_id': 'req-7683b578-af10-4d4d-8983-ff870aa5f89c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.124431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2f439651db4fcea62acc37f7e38009', 'request_id': 'req-7683b578-af10-4d4d-8983-ff870aa5f89c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.130895 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2f439651db4fcea62acc37f7e38009', 'request_id': 'req-7683b578-af10-4d4d-8983-ff870aa5f89c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.146351 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] The token cache is being invalidate because project 8a2f439651db4fcea62acc37f7e38009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:47:48.146625 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.147273 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.148963 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1431/2874] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:47:48 2022] DELETE /identity/v3/projects/8a2f439651db4fcea62acc37f7e38009 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:48.153207 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1466d-6459-4808-938f-6645efd53f1e service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:48.163451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1466d-6459-4808-938f-6645efd53f1e service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:48.219788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:48.220682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:48.220955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:48.221226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] PATH_INFO: `/v3/users/09fc4f93566b46dbb8fbbdf5b9667f98` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:48.222516 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fc4f93566b46dbb8fbbdf5b9667f98)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:48.224465 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:48.274127 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fc4f93566b46dbb8fbbdf5b9667f98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.274692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fc4f93566b46dbb8fbbdf5b9667f98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.275291 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fc4f93566b46dbb8fbbdf5b9667f98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.281995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fc4f93566b46dbb8fbbdf5b9667f98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.290181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f52daaa6-56f9-489a-ad96-322b3b7b2b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fc4f93566b46dbb8fbbdf5b9667f98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.307362 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1444/2875] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:47:48 2022] DELETE /identity/v3/users/09fc4f93566b46dbb8fbbdf5b9667f98 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:48.588093 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:48.589527 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:48.603898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683b578-af10-4d4d-8983-ff870aa5f89c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:48.662113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:48.663026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:48.663310 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:48.663587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] PATH_INFO: `/v3/projects/3f08fdca5f2b4dca89d94c62bdf7dadc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:48.664778 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f08fdca5f2b4dca89d94c62bdf7dadc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:48.666767 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:48.721058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f08fdca5f2b4dca89d94c62bdf7dadc', 'request_id': 'req-c0073caa-e188-4416-b1e8-47a0643ad864'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.727105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f08fdca5f2b4dca89d94c62bdf7dadc', 'request_id': 'req-c0073caa-e188-4416-b1e8-47a0643ad864'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.734519 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f08fdca5f2b4dca89d94c62bdf7dadc', 'request_id': 'req-c0073caa-e188-4416-b1e8-47a0643ad864'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.750328 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] The token cache is being invalidate because project 3f08fdca5f2b4dca89d94c62bdf7dadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:47:48.750703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.751569 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0073caa-e188-4416-b1e8-47a0643ad864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:48.753663 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1432/2876] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:47:48 2022] DELETE /identity/v3/projects/3f08fdca5f2b4dca89d94c62bdf7dadc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:48.758815 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40881f-3ecb-4537-a0a6-20bc3b3b0102 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:48.759271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40881f-3ecb-4537-a0a6-20bc3b3b0102 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:48.759375 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40881f-3ecb-4537-a0a6-20bc3b3b0102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:48.772692 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:48.779295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7d40881f-3ecb-4537-a0a6-20bc3b3b0102 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:48.781432 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7d40881f-3ecb-4537-a0a6-20bc3b3b0102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:48.844098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1445/2877] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:48.902544 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fcc15-4ed5-4893-91ac-6c4dd5f03ca0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:48.902802 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fcc15-4ed5-4893-91ac-6c4dd5f03ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:48.903205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fcc15-4ed5-4893-91ac-6c4dd5f03ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:48.928208 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-356fcc15-4ed5-4893-91ac-6c4dd5f03ca0 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:48.929429 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-356fcc15-4ed5-4893-91ac-6c4dd5f03ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:48.938468 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1433/2878] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:48.942787 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40881f-3ecb-4537-a0a6-20bc3b3b0102 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:48.953920 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40881f-3ecb-4537-a0a6-20bc3b3b0102 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:48.959725 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab44e5-431c-413e-8b77-85dbf0c91797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:48.960392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab44e5-431c-413e-8b77-85dbf0c91797 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:48.960671 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab44e5-431c-413e-8b77-85dbf0c91797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:48.960944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab44e5-431c-413e-8b77-85dbf0c91797 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:48.961668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab44e5-431c-413e-8b77-85dbf0c91797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:47:48.961979 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab44e5-431c-413e-8b77-85dbf0c91797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:48.963666 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab44e5-431c-413e-8b77-85dbf0c91797 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:48.976549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1446/2879] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:47:48.981210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fcc15-4ed5-4893-91ac-6c4dd5f03ca0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:48.991064 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fcc15-4ed5-4893-91ac-6c4dd5f03ca0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:48.997110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367575b9-0392-4233-a9be-498a5fddd83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:48.997841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367575b9-0392-4233-a9be-498a5fddd83e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:48.998124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367575b9-0392-4233-a9be-498a5fddd83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:48.998431 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367575b9-0392-4233-a9be-498a5fddd83e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:48.999125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367575b9-0392-4233-a9be-498a5fddd83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.001050 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367575b9-0392-4233-a9be-498a5fddd83e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.031725 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1434/2880] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:47:48 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:49.036039 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab44e5-431c-413e-8b77-85dbf0c91797 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.046986 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab44e5-431c-413e-8b77-85dbf0c91797 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.106816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7378b0e-0e0d-41b0-8698-f22384ab667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.107519 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7378b0e-0e0d-41b0-8698-f22384ab667d admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.107802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7378b0e-0e0d-41b0-8698-f22384ab667d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.108081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7378b0e-0e0d-41b0-8698-f22384ab667d admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.108793 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7378b0e-0e0d-41b0-8698-f22384ab667d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.110858 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7378b0e-0e0d-41b0-8698-f22384ab667d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.132167 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1447/2881] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:47:49 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:49.136505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367575b9-0392-4233-a9be-498a5fddd83e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.143644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:49.147497 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367575b9-0392-4233-a9be-498a5fddd83e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.153094 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452aad48-e865-4672-9d99-73cdfb6cf157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.154058 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aad48-e865-4672-9d99-73cdfb6cf157 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.154540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aad48-e865-4672-9d99-73cdfb6cf157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.154874 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aad48-e865-4672-9d99-73cdfb6cf157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.155619 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452aad48-e865-4672-9d99-73cdfb6cf157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.157214 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452aad48-e865-4672-9d99-73cdfb6cf157 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.168660 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1435/2882] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:49.173100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7378b0e-0e0d-41b0-8698-f22384ab667d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.183672 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7378b0e-0e0d-41b0-8698-f22384ab667d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.188938 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5fdb8-4da3-452c-89a5-f9d0a9a6f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.189626 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5fdb8-4da3-452c-89a5-f9d0a9a6f5ef admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.189914 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5fdb8-4da3-452c-89a5-f9d0a9a6f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.190238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5fdb8-4da3-452c-89a5-f9d0a9a6f5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.190974 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5fdb8-4da3-452c-89a5-f9d0a9a6f5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.192655 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5fdb8-4da3-452c-89a5-f9d0a9a6f5ef admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.203549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1448/2883] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:49.207983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452aad48-e865-4672-9d99-73cdfb6cf157 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.219173 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452aad48-e865-4672-9d99-73cdfb6cf157 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.225018 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448266-1e51-449e-92be-1509880df88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.225931 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448266-1e51-449e-92be-1509880df88f admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.226277 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448266-1e51-449e-92be-1509880df88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.226556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448266-1e51-449e-92be-1509880df88f admin admin] PATH_INFO: `/v3/projects/d1a8fd0f8da54cc9b1db1872094f18ac/users/542fd544e443420383bb7a2a59ae1372/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.241955 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9448266-1e51-449e-92be-1509880df88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a8fd0f8da54cc9b1db1872094f18ac, user_id=542fd544e443420383bb7a2a59ae1372, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.244757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9448266-1e51-449e-92be-1509880df88f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.260614 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1436/2884] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:49 2022] PUT /identity/v3/projects/d1a8fd0f8da54cc9b1db1872094f18ac/users/542fd544e443420383bb7a2a59ae1372/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:49.271172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794b712-d05e-45b5-a339-2abfe5710948 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.271466 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794b712-d05e-45b5-a339-2abfe5710948 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.271747 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794b712-d05e-45b5-a339-2abfe5710948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.299772 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1794b712-d05e-45b5-a339-2abfe5710948 None None] MFA Rules not processed for user `542fd544e443420383bb7a2a59ae1372`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:49.300987 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1794b712-d05e-45b5-a339-2abfe5710948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:49.370645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1449/2885] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:47:49.376498 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448266-1e51-449e-92be-1509880df88f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.447861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448266-1e51-449e-92be-1509880df88f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.454438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e107da-3275-468e-9e4d-580b32a33125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.455184 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e107da-3275-468e-9e4d-580b32a33125 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.455466 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e107da-3275-468e-9e4d-580b32a33125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.455739 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e107da-3275-468e-9e4d-580b32a33125 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.456460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e107da-3275-468e-9e4d-580b32a33125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.458464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e107da-3275-468e-9e4d-580b32a33125 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.490538 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1437/2886] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:47:49 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:47:49.494644 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794b712-d05e-45b5-a339-2abfe5710948 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.500579 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:49.510982 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794b712-d05e-45b5-a339-2abfe5710948 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.572754 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53553c00-259f-4938-bcd3-f766b316b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.573348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553c00-259f-4938-bcd3-f766b316b88a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.573632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553c00-259f-4938-bcd3-f766b316b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.573907 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553c00-259f-4938-bcd3-f766b316b88a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.574649 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53553c00-259f-4938-bcd3-f766b316b88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.576927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53553c00-259f-4938-bcd3-f766b316b88a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.598318 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1450/2887] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:47:49 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:49.603000 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e107da-3275-468e-9e4d-580b32a33125 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.614407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e107da-3275-468e-9e4d-580b32a33125 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.620409 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8810f1-143d-4ac0-b584-6f7b69582383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.621105 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8810f1-143d-4ac0-b584-6f7b69582383 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.621357 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8810f1-143d-4ac0-b584-6f7b69582383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.621655 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8810f1-143d-4ac0-b584-6f7b69582383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.622459 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8810f1-143d-4ac0-b584-6f7b69582383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.624117 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8810f1-143d-4ac0-b584-6f7b69582383 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.635116 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1438/2888] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:49.639532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53553c00-259f-4938-bcd3-f766b316b88a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.650504 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53553c00-259f-4938-bcd3-f766b316b88a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.656452 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317e790-a56f-456d-be3d-babae1e9f765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.657392 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317e790-a56f-456d-be3d-babae1e9f765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.657657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317e790-a56f-456d-be3d-babae1e9f765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.657954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317e790-a56f-456d-be3d-babae1e9f765 admin admin] PATH_INFO: `/v3/projects/b5e02680d59f41479028cb5047ea6cd4/users/2b48c74b514640fa992c2231422f131b/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.673457 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317e790-a56f-456d-be3d-babae1e9f765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e02680d59f41479028cb5047ea6cd4, user_id=2b48c74b514640fa992c2231422f131b, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.676234 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317e790-a56f-456d-be3d-babae1e9f765 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.692759 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1451/2889] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:49 2022] PUT /identity/v3/projects/b5e02680d59f41479028cb5047ea6cd4/users/2b48c74b514640fa992c2231422f131b/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:49.696793 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8810f1-143d-4ac0-b584-6f7b69582383 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.707026 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8810f1-143d-4ac0-b584-6f7b69582383 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.765681 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d81b17-9e40-4858-b7f8-aa077a4ee4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.766387 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81b17-9e40-4858-b7f8-aa077a4ee4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.766669 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81b17-9e40-4858-b7f8-aa077a4ee4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.766945 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d81b17-9e40-4858-b7f8-aa077a4ee4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.767717 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d81b17-9e40-4858-b7f8-aa077a4ee4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.769357 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d81b17-9e40-4858-b7f8-aa077a4ee4ff admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.779540 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1439/2890] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:49.783951 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317e790-a56f-456d-be3d-babae1e9f765 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.794898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317e790-a56f-456d-be3d-babae1e9f765 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:49.800798 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fb623-fef3-41c3-8776-d15423fea706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:49.801732 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fb623-fef3-41c3-8776-d15423fea706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.802014 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fb623-fef3-41c3-8776-d15423fea706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.802307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fb623-fef3-41c3-8776-d15423fea706 admin admin] PATH_INFO: `/v3/projects/b5e02680d59f41479028cb5047ea6cd4/users/2b48c74b514640fa992c2231422f131b/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.804477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fb623-fef3-41c3-8776-d15423fea706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e02680d59f41479028cb5047ea6cd4, user_id=2b48c74b514640fa992c2231422f131b, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:49.807255 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fb623-fef3-41c3-8776-d15423fea706 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:49.819927 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1452/2891] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:49 2022] PUT /identity/v3/projects/b5e02680d59f41479028cb5047ea6cd4/users/2b48c74b514640fa992c2231422f131b/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:49.830662 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302741d-c961-4071-83e5-98f0e58d4fd5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:49.830844 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302741d-c961-4071-83e5-98f0e58d4fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:49.831148 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302741d-c961-4071-83e5-98f0e58d4fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:49.860810 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5302741d-c961-4071-83e5-98f0e58d4fd5 None None] MFA Rules not processed for user `2b48c74b514640fa992c2231422f131b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:49.862015 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5302741d-c961-4071-83e5-98f0e58d4fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:49.892556 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:49.933986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1440/2892] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:49.946801 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fb623-fef3-41c3-8776-d15423fea706 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:49.949329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9a4fb623-fef3-41c3-8776-d15423fea706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:50.018104 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fb623-fef3-41c3-8776-d15423fea706 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:50.022713 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f476d-591d-43b4-bcca-dad514ef6086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:50.023387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f476d-591d-43b4-bcca-dad514ef6086 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:50.023669 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f476d-591d-43b4-bcca-dad514ef6086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:50.023975 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f476d-591d-43b4-bcca-dad514ef6086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:50.034499 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f476d-591d-43b4-bcca-dad514ef6086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:50.035989 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f476d-591d-43b4-bcca-dad514ef6086 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:50.046497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1453/2893] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:47:50.091587 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302741d-c961-4071-83e5-98f0e58d4fd5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:50.093224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5302741d-c961-4071-83e5-98f0e58d4fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:50.107882 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302741d-c961-4071-83e5-98f0e58d4fd5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:50.112864 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c869a-3dec-4325-92bf-548185568489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:50.113522 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c869a-3dec-4325-92bf-548185568489 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:50.113801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c869a-3dec-4325-92bf-548185568489 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:50.114177 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c869a-3dec-4325-92bf-548185568489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:50.185125 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c869a-3dec-4325-92bf-548185568489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:50.186622 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c869a-3dec-4325-92bf-548185568489 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:50.195611 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1441/2894] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:47:53.593250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f476d-591d-43b4-bcca-dad514ef6086 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:53.655223 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:53.659930 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f476d-591d-43b4-bcca-dad514ef6086 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:53.665566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:53.666490 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:53.666761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:53.667032 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] PATH_INFO: `/v3/users/542fd544e443420383bb7a2a59ae1372` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:53.668222 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] RBAC: Authorizing `identity:delete_user(user_id=542fd544e443420383bb7a2a59ae1372)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:53.670248 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:53.718134 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542fd544e443420383bb7a2a59ae1372'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:53.718813 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542fd544e443420383bb7a2a59ae1372'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:53.719741 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542fd544e443420383bb7a2a59ae1372'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:53.727343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542fd544e443420383bb7a2a59ae1372'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:53.737343 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542fd544e443420383bb7a2a59ae1372'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:53.754548 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1454/2895] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:47:53 2022] DELETE /identity/v3/users/542fd544e443420383bb7a2a59ae1372 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:53.759298 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7ef6-510d-4fe8-945b-a12dd2050ba8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:53.759779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7ef6-510d-4fe8-945b-a12dd2050ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:53.759876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad7ef6-510d-4fe8-945b-a12dd2050ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:53.778061 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-21ad7ef6-510d-4fe8-945b-a12dd2050ba8 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:53.779299 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-21ad7ef6-510d-4fe8-945b-a12dd2050ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:53.839777 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1442/2896] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:53.851991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:53.854876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:53.935407 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203a06f-dddd-4ec4-a1b7-47043c97edea admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:53.939944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685b220-120d-4d34-9280-b00ebbd721fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:53.940603 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685b220-120d-4d34-9280-b00ebbd721fb service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:53.940884 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685b220-120d-4d34-9280-b00ebbd721fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:53.941162 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685b220-120d-4d34-9280-b00ebbd721fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:53.950889 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685b220-120d-4d34-9280-b00ebbd721fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:53.952372 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685b220-120d-4d34-9280-b00ebbd721fb service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:53.963168 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1455/2897] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:47:54.241274 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad7ef6-510d-4fe8-945b-a12dd2050ba8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:54.242953 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-21ad7ef6-510d-4fe8-945b-a12dd2050ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:54.255505 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad7ef6-510d-4fe8-945b-a12dd2050ba8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:54.260622 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:54.261615 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:54.261971 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:54.262345 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] PATH_INFO: `/v3/projects/d1a8fd0f8da54cc9b1db1872094f18ac` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:54.263692 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a8fd0f8da54cc9b1db1872094f18ac)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:54.265911 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:54.320652 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a8fd0f8da54cc9b1db1872094f18ac', 'request_id': 'req-ff0ca092-ee0b-4221-972f-3636cff0a68c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.326411 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a8fd0f8da54cc9b1db1872094f18ac', 'request_id': 'req-ff0ca092-ee0b-4221-972f-3636cff0a68c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.327559 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:54.334635 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a8fd0f8da54cc9b1db1872094f18ac', 'request_id': 'req-ff0ca092-ee0b-4221-972f-3636cff0a68c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.348815 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] The token cache is being invalidate because project d1a8fd0f8da54cc9b1db1872094f18ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:47:54.349126 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.349743 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.351353 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1443/2898] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:47:54 2022] DELETE /identity/v3/projects/d1a8fd0f8da54cc9b1db1872094f18ac => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:54.357774 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685b220-120d-4d34-9280-b00ebbd721fb service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:54.368179 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685b220-120d-4d34-9280-b00ebbd721fb service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:54.429560 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:54.430485 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:54.430770 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:54.431044 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] PATH_INFO: `/v3/users/2b48c74b514640fa992c2231422f131b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:54.432266 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b48c74b514640fa992c2231422f131b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:54.434271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:54.455901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:54.485176 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b48c74b514640fa992c2231422f131b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.485838 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b48c74b514640fa992c2231422f131b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.486422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b48c74b514640fa992c2231422f131b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.493251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b48c74b514640fa992c2231422f131b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.501828 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc1d2974-beb1-4d92-8a2f-20bfa42d8725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b48c74b514640fa992c2231422f131b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.520377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1456/2899] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:47:54 2022] DELETE /identity/v3/users/2b48c74b514640fa992c2231422f131b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:54.809331 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:54.810827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:54.825386 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ca092-ee0b-4221-972f-3636cff0a68c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:54.891244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:54.892823 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:54.893108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:54.893389 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] PATH_INFO: `/v3/projects/b5e02680d59f41479028cb5047ea6cd4` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:54.894666 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e02680d59f41479028cb5047ea6cd4)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:54.897435 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:54.960744 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e02680d59f41479028cb5047ea6cd4', 'request_id': 'req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.967014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e02680d59f41479028cb5047ea6cd4', 'request_id': 'req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.974114 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e02680d59f41479028cb5047ea6cd4', 'request_id': 'req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.993207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] The token cache is being invalidate because project b5e02680d59f41479028cb5047ea6cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:47:54.993595 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.994530 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-457f5790-2b7f-4a20-8451-ad0c1b9d5b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:54.997034 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1444/2900] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:47:54 2022] DELETE /identity/v3/projects/b5e02680d59f41479028cb5047ea6cd4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:55.002652 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea8144-087a-493c-96bc-a7944b82aec4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.003137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea8144-087a-493c-96bc-a7944b82aec4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.003253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea8144-087a-493c-96bc-a7944b82aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.022263 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a5ea8144-087a-493c-96bc-a7944b82aec4 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:55.023462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a5ea8144-087a-493c-96bc-a7944b82aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:55.085958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1457/2901] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:55.095378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d5c14-c482-4bd6-b30b-8641abfb83ed None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.095671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d5c14-c482-4bd6-b30b-8641abfb83ed None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.095952 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d5c14-c482-4bd6-b30b-8641abfb83ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.115080 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-985d5c14-c482-4bd6-b30b-8641abfb83ed None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:55.116312 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-985d5c14-c482-4bd6-b30b-8641abfb83ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:55.125066 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1445/2902] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:55.131471 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea8144-087a-493c-96bc-a7944b82aec4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.144653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea8144-087a-493c-96bc-a7944b82aec4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.151734 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9939e0-48ee-4c2d-86af-83c631136548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.152410 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9939e0-48ee-4c2d-86af-83c631136548 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.152689 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9939e0-48ee-4c2d-86af-83c631136548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.152963 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9939e0-48ee-4c2d-86af-83c631136548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.153715 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9939e0-48ee-4c2d-86af-83c631136548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:47:55.154023 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9939e0-48ee-4c2d-86af-83c631136548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.155712 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9939e0-48ee-4c2d-86af-83c631136548 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.168253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1458/2903] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 13:47:55.172596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d5c14-c482-4bd6-b30b-8641abfb83ed None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.182258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d5c14-c482-4bd6-b30b-8641abfb83ed None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.187975 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc358b-ff47-42c5-a708-29b99d4d432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.188623 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc358b-ff47-42c5-a708-29b99d4d432a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.188902 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc358b-ff47-42c5-a708-29b99d4d432a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.189171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc358b-ff47-42c5-a708-29b99d4d432a admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.189861 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc358b-ff47-42c5-a708-29b99d4d432a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.191818 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc358b-ff47-42c5-a708-29b99d4d432a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.220923 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1446/2904] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:47:55 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:55.225137 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9939e0-48ee-4c2d-86af-83c631136548 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.235806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9939e0-48ee-4c2d-86af-83c631136548 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.307041 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65609721-915e-4d15-a316-ea063a19a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.307731 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65609721-915e-4d15-a316-ea063a19a9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.308018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65609721-915e-4d15-a316-ea063a19a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.308295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65609721-915e-4d15-a316-ea063a19a9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.309018 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65609721-915e-4d15-a316-ea063a19a9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.311061 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65609721-915e-4d15-a316-ea063a19a9c6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.333204 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1459/2905] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:47:55 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:55.337564 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc358b-ff47-42c5-a708-29b99d4d432a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.348361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc358b-ff47-42c5-a708-29b99d4d432a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.354372 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525fd29-305f-4255-ad25-dc4f3c6d9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.355113 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525fd29-305f-4255-ad25-dc4f3c6d9dad admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.355388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525fd29-305f-4255-ad25-dc4f3c6d9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.355693 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525fd29-305f-4255-ad25-dc4f3c6d9dad admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.356443 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525fd29-305f-4255-ad25-dc4f3c6d9dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.358144 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525fd29-305f-4255-ad25-dc4f3c6d9dad admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.369205 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1447/2906] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:55.373632 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65609721-915e-4d15-a316-ea063a19a9c6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.386755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65609721-915e-4d15-a316-ea063a19a9c6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.391648 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff43a83-8de0-4b0f-93e7-d08925870682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.392327 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43a83-8de0-4b0f-93e7-d08925870682 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.392609 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43a83-8de0-4b0f-93e7-d08925870682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.392886 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff43a83-8de0-4b0f-93e7-d08925870682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.393614 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff43a83-8de0-4b0f-93e7-d08925870682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.395348 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff43a83-8de0-4b0f-93e7-d08925870682 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.405587 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1460/2907] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:55.410247 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525fd29-305f-4255-ad25-dc4f3c6d9dad admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.420460 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525fd29-305f-4255-ad25-dc4f3c6d9dad admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.425241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892ca6-6e84-4586-9a49-9f54fcc8c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.426197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892ca6-6e84-4586-9a49-9f54fcc8c9ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.426475 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892ca6-6e84-4586-9a49-9f54fcc8c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.426754 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892ca6-6e84-4586-9a49-9f54fcc8c9ce admin admin] PATH_INFO: `/v3/projects/55a2cf37a2e945cd8e2ff860d78c0034/users/7bf10ee255de416a862cbe135037c122/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.447024 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03892ca6-6e84-4586-9a49-9f54fcc8c9ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a2cf37a2e945cd8e2ff860d78c0034, user_id=7bf10ee255de416a862cbe135037c122, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.450025 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03892ca6-6e84-4586-9a49-9f54fcc8c9ce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.466175 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1448/2908] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:55 2022] PUT /identity/v3/projects/55a2cf37a2e945cd8e2ff860d78c0034/users/7bf10ee255de416a862cbe135037c122/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 13:47:55.478272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5cbc-4df0-4541-8f07-e41b8aed2c10 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.478673 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5cbc-4df0-4541-8f07-e41b8aed2c10 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.479118 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5cbc-4df0-4541-8f07-e41b8aed2c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.488650 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:55.516574 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-017b5cbc-4df0-4541-8f07-e41b8aed2c10 None None] MFA Rules not processed for user `7bf10ee255de416a862cbe135037c122`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:55.517786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-017b5cbc-4df0-4541-8f07-e41b8aed2c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:55.595062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1461/2909] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:55.601438 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892ca6-6e84-4586-9a49-9f54fcc8c9ce admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.616037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:55.667037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892ca6-6e84-4586-9a49-9f54fcc8c9ce admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.672433 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3f5fe-9df4-45ba-806d-a3e309df465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.672944 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3f5fe-9df4-45ba-806d-a3e309df465b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.673231 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3f5fe-9df4-45ba-806d-a3e309df465b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.673511 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3f5fe-9df4-45ba-806d-a3e309df465b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.674257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3f5fe-9df4-45ba-806d-a3e309df465b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.676241 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3f5fe-9df4-45ba-806d-a3e309df465b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.708378 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1449/2910] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:47:55 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:55.714965 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5cbc-4df0-4541-8f07-e41b8aed2c10 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.728775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5cbc-4df0-4541-8f07-e41b8aed2c10 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.787172 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d19c28-d720-41f4-9ef8-cc5d9942c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.787877 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d19c28-d720-41f4-9ef8-cc5d9942c39f admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.788161 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d19c28-d720-41f4-9ef8-cc5d9942c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.788436 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d19c28-d720-41f4-9ef8-cc5d9942c39f admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.789144 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d19c28-d720-41f4-9ef8-cc5d9942c39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.791177 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d19c28-d720-41f4-9ef8-cc5d9942c39f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.817445 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1462/2911] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:47:55 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:55.821465 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3f5fe-9df4-45ba-806d-a3e309df465b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.832300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3f5fe-9df4-45ba-806d-a3e309df465b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.838210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e9631-4110-4eaa-9614-04f8d69086b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.838879 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e9631-4110-4eaa-9614-04f8d69086b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.839159 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e9631-4110-4eaa-9614-04f8d69086b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.839432 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e9631-4110-4eaa-9614-04f8d69086b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.840157 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e9631-4110-4eaa-9614-04f8d69086b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.841796 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e9631-4110-4eaa-9614-04f8d69086b2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.854644 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1450/2912] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 13:47:55.858922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d19c28-d720-41f4-9ef8-cc5d9942c39f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.870341 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d19c28-d720-41f4-9ef8-cc5d9942c39f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.876873 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1db38-d1b8-4ea5-8a7d-8bc9275a96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.877785 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1db38-d1b8-4ea5-8a7d-8bc9275a96a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.878069 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1db38-d1b8-4ea5-8a7d-8bc9275a96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.878387 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1db38-d1b8-4ea5-8a7d-8bc9275a96a8 admin admin] PATH_INFO: `/v3/projects/a9b8d5b4fd944385902a0ee88b3b319f/users/32b1187f022349e9833e454c92d63481/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.895188 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1db38-d1b8-4ea5-8a7d-8bc9275a96a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b8d5b4fd944385902a0ee88b3b319f, user_id=32b1187f022349e9833e454c92d63481, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.897935 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1db38-d1b8-4ea5-8a7d-8bc9275a96a8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:55.913885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1463/2913] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:55 2022] PUT /identity/v3/projects/a9b8d5b4fd944385902a0ee88b3b319f/users/32b1187f022349e9833e454c92d63481/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:55.917951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e9631-4110-4eaa-9614-04f8d69086b2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:55.928827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e9631-4110-4eaa-9614-04f8d69086b2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:55.988190 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bca16-72f6-42a0-a8f0-71ef41b3edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:55.988887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bca16-72f6-42a0-a8f0-71ef41b3edbe admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:55.989163 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bca16-72f6-42a0-a8f0-71ef41b3edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:55.989436 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bca16-72f6-42a0-a8f0-71ef41b3edbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:55.990197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bca16-72f6-42a0-a8f0-71ef41b3edbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:55.991830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bca16-72f6-42a0-a8f0-71ef41b3edbe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:56.002183 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1451/2914] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:56.006531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1db38-d1b8-4ea5-8a7d-8bc9275a96a8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:56.017842 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1db38-d1b8-4ea5-8a7d-8bc9275a96a8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:56.022761 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a0362-fe61-462c-a4b8-00fd52fe689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:56.023656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0362-fe61-462c-a4b8-00fd52fe689c admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:56.023941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0362-fe61-462c-a4b8-00fd52fe689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:56.024219 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0362-fe61-462c-a4b8-00fd52fe689c admin admin] PATH_INFO: `/v3/projects/a9b8d5b4fd944385902a0ee88b3b319f/users/32b1187f022349e9833e454c92d63481/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:56.026257 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a0362-fe61-462c-a4b8-00fd52fe689c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b8d5b4fd944385902a0ee88b3b319f, user_id=32b1187f022349e9833e454c92d63481, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:56.028958 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a0362-fe61-462c-a4b8-00fd52fe689c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:56.039527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1464/2915] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:56 2022] PUT /identity/v3/projects/a9b8d5b4fd944385902a0ee88b3b319f/users/32b1187f022349e9833e454c92d63481/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:56.050755 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41fae1-008d-46de-a692-5dc6e0509198 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:56.051049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41fae1-008d-46de-a692-5dc6e0509198 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:56.051334 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41fae1-008d-46de-a692-5dc6e0509198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:56.085631 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7a41fae1-008d-46de-a692-5dc6e0509198 None None] MFA Rules not processed for user `32b1187f022349e9833e454c92d63481`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:56.086863 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7a41fae1-008d-46de-a692-5dc6e0509198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:56.158106 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1452/2916] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:56.168388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565510e-fe04-4d3a-8d2c-ea8e3a46a400 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:56.168613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565510e-fe04-4d3a-8d2c-ea8e3a46a400 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:56.168893 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565510e-fe04-4d3a-8d2c-ea8e3a46a400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:56.208653 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5565510e-fe04-4d3a-8d2c-ea8e3a46a400 None None] MFA Rules not processed for user `68fc7c689f3645149d927663730bab5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:56.209880 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5565510e-fe04-4d3a-8d2c-ea8e3a46a400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:56.239991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:56.263451 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1465/2917] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Jun 17 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:56.271014 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41fae1-008d-46de-a692-5dc6e0509198 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:56.281867 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41fae1-008d-46de-a692-5dc6e0509198 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:56.285951 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756f433-fca9-4322-bba6-97c0a364fd9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:56.286654 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756f433-fca9-4322-bba6-97c0a364fd9a service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:56.286996 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756f433-fca9-4322-bba6-97c0a364fd9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:56.287350 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756f433-fca9-4322-bba6-97c0a364fd9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:56.295189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:56.297858 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756f433-fca9-4322-bba6-97c0a364fd9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:56.299748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756f433-fca9-4322-bba6-97c0a364fd9a service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:56.310927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1453/2918] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:47:56.732786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565510e-fe04-4d3a-8d2c-ea8e3a46a400 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:56.797668 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565510e-fe04-4d3a-8d2c-ea8e3a46a400 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:56.803565 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:56.804497 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:56.804783 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:56.805056 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] PATH_INFO: `/v3/users/7bf10ee255de416a862cbe135037c122` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:56.806474 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf10ee255de416a862cbe135037c122)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:56.808487 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:56.861861 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf10ee255de416a862cbe135037c122'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:56.862605 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf10ee255de416a862cbe135037c122'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:56.863196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf10ee255de416a862cbe135037c122'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:56.870518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf10ee255de416a862cbe135037c122'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:56.880216 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf10ee255de416a862cbe135037c122'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:56.898834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1466/2919] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:47:56 2022] DELETE /identity/v3/users/7bf10ee255de416a862cbe135037c122 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:56.903575 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2635cd-e16a-4132-a2a5-6feee3e696a3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:56.904042 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2635cd-e16a-4132-a2a5-6feee3e696a3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:56.904140 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2635cd-e16a-4132-a2a5-6feee3e696a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:56.921989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1d2635cd-e16a-4132-a2a5-6feee3e696a3 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:56.923232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d2635cd-e16a-4132-a2a5-6feee3e696a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:56.985360 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1454/2920] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:56.995518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:56.997046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:57.055950 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f14538-52de-4360-a95c-ccaa103b4eae admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:57.062977 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fc398-6a71-4b98-a895-2aa54218d5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:57.063816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fc398-6a71-4b98-a895-2aa54218d5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:57.064170 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fc398-6a71-4b98-a895-2aa54218d5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:57.064385 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fc398-6a71-4b98-a895-2aa54218d5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:57.080210 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fc398-6a71-4b98-a895-2aa54218d5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:57.081756 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fc398-6a71-4b98-a895-2aa54218d5a9 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:57.091826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1467/2921] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:47:57.385824 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2635cd-e16a-4132-a2a5-6feee3e696a3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:57.387319 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d2635cd-e16a-4132-a2a5-6feee3e696a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:57.399775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2635cd-e16a-4132-a2a5-6feee3e696a3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:57.405245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:57.406244 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:57.406536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:57.406797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] PATH_INFO: `/v3/projects/55a2cf37a2e945cd8e2ff860d78c0034` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:57.408337 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a2cf37a2e945cd8e2ff860d78c0034)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:57.410316 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:57.459245 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a2cf37a2e945cd8e2ff860d78c0034', 'request_id': 'req-2283682b-3d03-4791-9a1e-32f54a418195'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.464989 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a2cf37a2e945cd8e2ff860d78c0034', 'request_id': 'req-2283682b-3d03-4791-9a1e-32f54a418195'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.471495 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a2cf37a2e945cd8e2ff860d78c0034', 'request_id': 'req-2283682b-3d03-4791-9a1e-32f54a418195'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.488840 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] The token cache is being invalidate because project 55a2cf37a2e945cd8e2ff860d78c0034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:47:57.489060 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.489711 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.491340 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1455/2922] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:47:57 2022] DELETE /identity/v3/projects/55a2cf37a2e945cd8e2ff860d78c0034 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:57.495568 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fc398-6a71-4b98-a895-2aa54218d5a9 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:57.501901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:57.506299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fc398-6a71-4b98-a895-2aa54218d5a9 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:57.569640 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:57.570584 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:57.570865 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:57.571147 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] PATH_INFO: `/v3/users/32b1187f022349e9833e454c92d63481` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:57.572352 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b1187f022349e9833e454c92d63481)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:57.574444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:57.637752 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b1187f022349e9833e454c92d63481'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.638464 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b1187f022349e9833e454c92d63481'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.639078 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b1187f022349e9833e454c92d63481'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.647187 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b1187f022349e9833e454c92d63481'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.656738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff6462ed-aa27-4bc5-b40d-784e71d8ca2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b1187f022349e9833e454c92d63481'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:57.675374 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1468/2923] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:47:57 2022] DELETE /identity/v3/users/32b1187f022349e9833e454c92d63481 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:57.953154 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:57.955186 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:57.970470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283682b-3d03-4791-9a1e-32f54a418195 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:58.029596 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:58.030444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.030709 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.030983 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] PATH_INFO: `/v3/projects/a9b8d5b4fd944385902a0ee88b3b319f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.032219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b8d5b4fd944385902a0ee88b3b319f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:58.034362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:58.056999 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:58.085991 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b8d5b4fd944385902a0ee88b3b319f', 'request_id': 'req-79ea6097-ad66-4177-8d25-9d2447eebbda'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:58.091528 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b8d5b4fd944385902a0ee88b3b319f', 'request_id': 'req-79ea6097-ad66-4177-8d25-9d2447eebbda'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:58.097687 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b8d5b4fd944385902a0ee88b3b319f', 'request_id': 'req-79ea6097-ad66-4177-8d25-9d2447eebbda'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:58.111958 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] The token cache is being invalidate because project a9b8d5b4fd944385902a0ee88b3b319f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:47:58.112240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:58.112853 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-79ea6097-ad66-4177-8d25-9d2447eebbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:47:58.114450 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1456/2924] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:47:57 2022] DELETE /identity/v3/projects/a9b8d5b4fd944385902a0ee88b3b319f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:58.120256 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8360f1a-efb9-4b14-ac35-9426feb9bf4d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.120738 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8360f1a-efb9-4b14-ac35-9426feb9bf4d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.120830 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8360f1a-efb9-4b14-ac35-9426feb9bf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.142316 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c8360f1a-efb9-4b14-ac35-9426feb9bf4d None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:58.143597 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c8360f1a-efb9-4b14-ac35-9426feb9bf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:58.208939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1469/2925] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 13:47:58.217138 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67693d3-4b1c-4f2d-9de6-323c5859577a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.217425 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67693d3-4b1c-4f2d-9de6-323c5859577a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.217703 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67693d3-4b1c-4f2d-9de6-323c5859577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.238254 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d67693d3-4b1c-4f2d-9de6-323c5859577a None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:58.239499 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d67693d3-4b1c-4f2d-9de6-323c5859577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:58.248124 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1457/2926] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:58.252607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8360f1a-efb9-4b14-ac35-9426feb9bf4d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:58.263211 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8360f1a-efb9-4b14-ac35-9426feb9bf4d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:58.269551 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32204a-1c26-4786-a01d-f3be58356a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:58.270275 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32204a-1c26-4786-a01d-f3be58356a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.270566 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32204a-1c26-4786-a01d-f3be58356a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.270843 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32204a-1c26-4786-a01d-f3be58356a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.271570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32204a-1c26-4786-a01d-f3be58356a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:47:58.271876 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32204a-1c26-4786-a01d-f3be58356a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:58.273534 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32204a-1c26-4786-a01d-f3be58356a39 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:58.286077 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1470/2927] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:47:58.290566 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67693d3-4b1c-4f2d-9de6-323c5859577a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:58.300170 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67693d3-4b1c-4f2d-9de6-323c5859577a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:58.305300 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955d442-3128-4ba8-b1bf-71ca88ba0594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:58.305967 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955d442-3128-4ba8-b1bf-71ca88ba0594 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.306287 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955d442-3128-4ba8-b1bf-71ca88ba0594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.306567 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955d442-3128-4ba8-b1bf-71ca88ba0594 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.307257 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955d442-3128-4ba8-b1bf-71ca88ba0594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:58.309171 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955d442-3128-4ba8-b1bf-71ca88ba0594 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:58.337147 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1458/2928] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:47:58 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:58.341442 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32204a-1c26-4786-a01d-f3be58356a39 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:58.352071 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32204a-1c26-4786-a01d-f3be58356a39 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:58.360905 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:47:58.415406 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff078b0-7cc6-4375-a9e6-998067e13311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:58.416095 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff078b0-7cc6-4375-a9e6-998067e13311 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.416409 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff078b0-7cc6-4375-a9e6-998067e13311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.416694 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff078b0-7cc6-4375-a9e6-998067e13311 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.417377 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff078b0-7cc6-4375-a9e6-998067e13311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:58.419405 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff078b0-7cc6-4375-a9e6-998067e13311 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:58.442834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1471/2929] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:47:58 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:47:58.447240 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955d442-3128-4ba8-b1bf-71ca88ba0594 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:58.457954 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955d442-3128-4ba8-b1bf-71ca88ba0594 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:58.462799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9295-66e2-40f8-974a-d16fe3bf68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:58.463463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9295-66e2-40f8-974a-d16fe3bf68d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.463742 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9295-66e2-40f8-974a-d16fe3bf68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.464016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9295-66e2-40f8-974a-d16fe3bf68d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.464765 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d9295-66e2-40f8-974a-d16fe3bf68d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:58.466478 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d9295-66e2-40f8-974a-d16fe3bf68d0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:58.477284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1459/2930] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:58.481739 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff078b0-7cc6-4375-a9e6-998067e13311 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:58.492693 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff078b0-7cc6-4375-a9e6-998067e13311 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:58.497612 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0be33f-57ff-4d00-93cd-295923cb1250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:58.498333 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0be33f-57ff-4d00-93cd-295923cb1250 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.498622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0be33f-57ff-4d00-93cd-295923cb1250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.498895 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0be33f-57ff-4d00-93cd-295923cb1250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.499624 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0be33f-57ff-4d00-93cd-295923cb1250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:58.501270 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0be33f-57ff-4d00-93cd-295923cb1250 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:58.512229 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1472/2931] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:47:58.516667 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9295-66e2-40f8-974a-d16fe3bf68d0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:58.527756 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9295-66e2-40f8-974a-d16fe3bf68d0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:58.534047 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c8f18-8ed4-4698-892c-0a02eaab60a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:58.534986 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8f18-8ed4-4698-892c-0a02eaab60a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.535232 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8f18-8ed4-4698-892c-0a02eaab60a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.535533 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8f18-8ed4-4698-892c-0a02eaab60a3 admin admin] PATH_INFO: `/v3/projects/281f97efa4c14885a01e39bd1b902255/users/53c86b80f1874058afef251c99fa6b2e/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.551799 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c8f18-8ed4-4698-892c-0a02eaab60a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=281f97efa4c14885a01e39bd1b902255, user_id=53c86b80f1874058afef251c99fa6b2e, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:58.554470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c8f18-8ed4-4698-892c-0a02eaab60a3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:58.581816 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1460/2932] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:47:58 2022] PUT /identity/v3/projects/281f97efa4c14885a01e39bd1b902255/users/53c86b80f1874058afef251c99fa6b2e/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:47:58.593383 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6900db-5181-48dc-b2cc-ebd9625bb69e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.593683 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6900db-5181-48dc-b2cc-ebd9625bb69e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.594062 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6900db-5181-48dc-b2cc-ebd9625bb69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.625098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9d6900db-5181-48dc-b2cc-ebd9625bb69e None None] MFA Rules not processed for user `53c86b80f1874058afef251c99fa6b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:47:58.626361 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9d6900db-5181-48dc-b2cc-ebd9625bb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:58.699038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1473/2933] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:47:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:47:58.710885 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c8f18-8ed4-4698-892c-0a02eaab60a3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:47:58.712992 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d27c8f18-8ed4-4698-892c-0a02eaab60a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:47:58.801229 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c8f18-8ed4-4698-892c-0a02eaab60a3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:47:58.806201 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b7296-aae0-499a-8480-07e5ab9424d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984780a6a8df405dbbb2ba4c46dd841c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:47:58.806809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b7296-aae0-499a-8480-07e5ab9424d8 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:47:58.807094 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b7296-aae0-499a-8480-07e5ab9424d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:47:58.807369 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b7296-aae0-499a-8480-07e5ab9424d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:47:58.816525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b7296-aae0-499a-8480-07e5ab9424d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:47:58.817979 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b7296-aae0-499a-8480-07e5ab9424d8 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:47:58.827162 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1461/2934] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:47:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:48:08.695831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:08.822926 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=7,keystone:SELECT=77,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:23.939307 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6900db-5181-48dc-b2cc-ebd9625bb69e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:24.006527 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6900db-5181-48dc-b2cc-ebd9625bb69e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:24.011554 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:24.012444 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:24.012723 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:24.012991 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] PATH_INFO: `/v3/users/53c86b80f1874058afef251c99fa6b2e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:24.014251 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c86b80f1874058afef251c99fa6b2e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:24.016226 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:24.071150 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c86b80f1874058afef251c99fa6b2e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.071825 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c86b80f1874058afef251c99fa6b2e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.072462 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c86b80f1874058afef251c99fa6b2e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.079454 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c86b80f1874058afef251c99fa6b2e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.089419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c86b80f1874058afef251c99fa6b2e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.108777 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1474/2935] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:48:23 2022] DELETE /identity/v3/users/53c86b80f1874058afef251c99fa6b2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:24.113691 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd18bf-967b-4d4f-9f2d-7c91739f7b23 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:24.114523 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd18bf-967b-4d4f-9f2d-7c91739f7b23 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:24.114523 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd18bf-967b-4d4f-9f2d-7c91739f7b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:24.134182 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-52dd18bf-967b-4d4f-9f2d-7c91739f7b23 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:24.135414 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-52dd18bf-967b-4d4f-9f2d-7c91739f7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:24.199747 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1462/2936] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:24.214826 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:24.216413 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:24.281295 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d7f9e-0ea9-44ab-a0e6-ef4a7bfa31dd admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:24.285422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f35622-62b1-4049-9402-6fc40fcdb6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:24.286126 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f35622-62b1-4049-9402-6fc40fcdb6dc service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:24.286415 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f35622-62b1-4049-9402-6fc40fcdb6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:24.286695 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f35622-62b1-4049-9402-6fc40fcdb6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:24.296192 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f35622-62b1-4049-9402-6fc40fcdb6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:24.297703 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f35622-62b1-4049-9402-6fc40fcdb6dc service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:24.307382 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1475/2937] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:48:24.594040 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd18bf-967b-4d4f-9f2d-7c91739f7b23 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:24.595694 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-52dd18bf-967b-4d4f-9f2d-7c91739f7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:24.609800 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd18bf-967b-4d4f-9f2d-7c91739f7b23 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:24.616318 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:24.617410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:24.617718 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:24.617995 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] PATH_INFO: `/v3/projects/281f97efa4c14885a01e39bd1b902255` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:24.619420 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=281f97efa4c14885a01e39bd1b902255)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:24.621463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:24.681898 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281f97efa4c14885a01e39bd1b902255', 'request_id': 'req-65472a40-a372-4331-8651-510da566f6b5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.687930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281f97efa4c14885a01e39bd1b902255', 'request_id': 'req-65472a40-a372-4331-8651-510da566f6b5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.694216 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281f97efa4c14885a01e39bd1b902255', 'request_id': 'req-65472a40-a372-4331-8651-510da566f6b5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.709049 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] The token cache is being invalidate because project 281f97efa4c14885a01e39bd1b902255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:48:24.709259 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.710038 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65472a40-a372-4331-8651-510da566f6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:24.711727 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1463/2938] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:48:24 2022] DELETE /identity/v3/projects/281f97efa4c14885a01e39bd1b902255 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:24.716726 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fa134-db62-4eab-8245-cb2adbc1c24f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:24.717017 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fa134-db62-4eab-8245-cb2adbc1c24f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:24.717297 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fa134-db62-4eab-8245-cb2adbc1c24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:24.735576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bf1fa134-db62-4eab-8245-cb2adbc1c24f None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:24.736822 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bf1fa134-db62-4eab-8245-cb2adbc1c24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:24.755180 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:24.800729 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1476/2939] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:24.808484 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c794ce-6d2a-4348-ae06-74327e3447aa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:24.808760 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c794ce-6d2a-4348-ae06-74327e3447aa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:24.809077 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c794ce-6d2a-4348-ae06-74327e3447aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:24.829137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-87c794ce-6d2a-4348-ae06-74327e3447aa None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:24.830397 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87c794ce-6d2a-4348-ae06-74327e3447aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:24.839134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1464/2940] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:24.843998 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fa134-db62-4eab-8245-cb2adbc1c24f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:24.858277 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fa134-db62-4eab-8245-cb2adbc1c24f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:24.864846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed6ad-b23b-463c-b69f-dab1c1f10ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:24.865518 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed6ad-b23b-463c-b69f-dab1c1f10ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:24.865803 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed6ad-b23b-463c-b69f-dab1c1f10ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:24.866081 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed6ad-b23b-463c-b69f-dab1c1f10ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:24.867281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bed6ad-b23b-463c-b69f-dab1c1f10ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:48:24.867595 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bed6ad-b23b-463c-b69f-dab1c1f10ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:24.869253 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bed6ad-b23b-463c-b69f-dab1c1f10ccd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:24.883529 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1477/2941] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 13:48:24.888504 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c794ce-6d2a-4348-ae06-74327e3447aa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:24.901964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c794ce-6d2a-4348-ae06-74327e3447aa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:24.910797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5dfe-3a6b-4bba-b549-0ac8a2fed5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:24.911827 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5dfe-3a6b-4bba-b549-0ac8a2fed5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:24.912210 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5dfe-3a6b-4bba-b549-0ac8a2fed5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:24.912546 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a5dfe-3a6b-4bba-b549-0ac8a2fed5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:24.913808 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a5dfe-3a6b-4bba-b549-0ac8a2fed5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:24.915757 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a5dfe-3a6b-4bba-b549-0ac8a2fed5f7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:24.945016 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1465/2942] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:48:24 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:48:24.950711 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed6ad-b23b-463c-b69f-dab1c1f10ccd admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:24.961807 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed6ad-b23b-463c-b69f-dab1c1f10ccd admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.028656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf72cb2-057b-4e04-ba6f-819bf99515d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.029593 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf72cb2-057b-4e04-ba6f-819bf99515d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.029995 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf72cb2-057b-4e04-ba6f-819bf99515d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.030386 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf72cb2-057b-4e04-ba6f-819bf99515d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.031441 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf72cb2-057b-4e04-ba6f-819bf99515d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.034588 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf72cb2-057b-4e04-ba6f-819bf99515d0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.059836 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1478/2943] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:48:24 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:48:25.064085 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5dfe-3a6b-4bba-b549-0ac8a2fed5f7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.075263 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a5dfe-3a6b-4bba-b549-0ac8a2fed5f7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.080388 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69d5c-8ee1-4b9e-8339-9aebe0ca45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.081070 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69d5c-8ee1-4b9e-8339-9aebe0ca45a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.081346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69d5c-8ee1-4b9e-8339-9aebe0ca45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.081616 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69d5c-8ee1-4b9e-8339-9aebe0ca45a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.082413 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe69d5c-8ee1-4b9e-8339-9aebe0ca45a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.084054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe69d5c-8ee1-4b9e-8339-9aebe0ca45a3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.095079 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1466/2944] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:48:25.099320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf72cb2-057b-4e04-ba6f-819bf99515d0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.111359 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf72cb2-057b-4e04-ba6f-819bf99515d0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.117820 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1042ea-cd93-455d-bed7-b3a7b31b3899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.118532 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1042ea-cd93-455d-bed7-b3a7b31b3899 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.118819 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1042ea-cd93-455d-bed7-b3a7b31b3899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.119098 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1042ea-cd93-455d-bed7-b3a7b31b3899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.119824 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1042ea-cd93-455d-bed7-b3a7b31b3899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.121479 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1042ea-cd93-455d-bed7-b3a7b31b3899 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.131662 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1479/2945] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:48:25.135835 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69d5c-8ee1-4b9e-8339-9aebe0ca45a3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.146234 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69d5c-8ee1-4b9e-8339-9aebe0ca45a3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.151189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f7a01-77b7-47ae-8873-cf56a387ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.152100 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7a01-77b7-47ae-8873-cf56a387ac67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.152377 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7a01-77b7-47ae-8873-cf56a387ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.152664 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7a01-77b7-47ae-8873-cf56a387ac67 admin admin] PATH_INFO: `/v3/projects/f30d06e83d6d444db2283b68f5ee52c9/users/41594ddc445d4613ac2d50656df6cb30/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.167415 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f7a01-77b7-47ae-8873-cf56a387ac67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30d06e83d6d444db2283b68f5ee52c9, user_id=41594ddc445d4613ac2d50656df6cb30, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.170189 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f7a01-77b7-47ae-8873-cf56a387ac67 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.185275 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1467/2946] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:48:25 2022] PUT /identity/v3/projects/f30d06e83d6d444db2283b68f5ee52c9/users/41594ddc445d4613ac2d50656df6cb30/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:25.195788 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6e5b6-4bd1-4939-bfb4-c4870d8202c2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.196228 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6e5b6-4bd1-4939-bfb4-c4870d8202c2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.196506 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6e5b6-4bd1-4939-bfb4-c4870d8202c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.224656 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8ac6e5b6-4bd1-4939-bfb4-c4870d8202c2 None None] MFA Rules not processed for user `41594ddc445d4613ac2d50656df6cb30`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:25.225806 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8ac6e5b6-4bd1-4939-bfb4-c4870d8202c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:25.293271 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1480/2947] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:25.297870 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f7a01-77b7-47ae-8873-cf56a387ac67 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.322072 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:25.366726 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f7a01-77b7-47ae-8873-cf56a387ac67 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.373176 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccab59-2759-4e83-8c54-024a4440e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.373850 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccab59-2759-4e83-8c54-024a4440e79e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.374134 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccab59-2759-4e83-8c54-024a4440e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.374444 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccab59-2759-4e83-8c54-024a4440e79e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.375137 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccab59-2759-4e83-8c54-024a4440e79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.377069 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccab59-2759-4e83-8c54-024a4440e79e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.411964 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1468/2948] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:48:25 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:48:25.416477 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6e5b6-4bd1-4939-bfb4-c4870d8202c2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.428238 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6e5b6-4bd1-4939-bfb4-c4870d8202c2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.441618 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:25.488932 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbbbec-0ef4-41ab-be41-9349e1039160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.489538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbbbec-0ef4-41ab-be41-9349e1039160 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.489834 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbbbec-0ef4-41ab-be41-9349e1039160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.490124 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbbbec-0ef4-41ab-be41-9349e1039160 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.490831 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbbbec-0ef4-41ab-be41-9349e1039160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.493038 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbbbec-0ef4-41ab-be41-9349e1039160 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.517318 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1481/2949] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:48:25 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:48:25.521360 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccab59-2759-4e83-8c54-024a4440e79e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.531841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccab59-2759-4e83-8c54-024a4440e79e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.538324 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1960-2fb2-432e-a0fb-3357100b89a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.539507 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1960-2fb2-432e-a0fb-3357100b89a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.539638 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1960-2fb2-432e-a0fb-3357100b89a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.539833 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1960-2fb2-432e-a0fb-3357100b89a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.540570 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1960-2fb2-432e-a0fb-3357100b89a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.542251 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1960-2fb2-432e-a0fb-3357100b89a0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.553108 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1469/2950] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:48:25.557539 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbbbec-0ef4-41ab-be41-9349e1039160 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.568143 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbbbec-0ef4-41ab-be41-9349e1039160 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.575329 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cf17b-2eaa-43d5-99d4-59bedbf76c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.576576 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cf17b-2eaa-43d5-99d4-59bedbf76c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.576954 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cf17b-2eaa-43d5-99d4-59bedbf76c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.577344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cf17b-2eaa-43d5-99d4-59bedbf76c61 admin admin] PATH_INFO: `/v3/projects/a7193800cfa54655b6793f4325f4a9ba/users/4d6a6184724249c092aa3375dcb3121d/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.600372 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cf17b-2eaa-43d5-99d4-59bedbf76c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7193800cfa54655b6793f4325f4a9ba, user_id=4d6a6184724249c092aa3375dcb3121d, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.603860 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cf17b-2eaa-43d5-99d4-59bedbf76c61 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.619570 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1482/2951] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:48:25 2022] PUT /identity/v3/projects/a7193800cfa54655b6793f4325f4a9ba/users/4d6a6184724249c092aa3375dcb3121d/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:25.625797 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1960-2fb2-432e-a0fb-3357100b89a0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.638609 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1960-2fb2-432e-a0fb-3357100b89a0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.699395 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb44a5-dafd-4721-be37-e6e0d4e9c388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.700084 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb44a5-dafd-4721-be37-e6e0d4e9c388 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.700364 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb44a5-dafd-4721-be37-e6e0d4e9c388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.701099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb44a5-dafd-4721-be37-e6e0d4e9c388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.701396 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb44a5-dafd-4721-be37-e6e0d4e9c388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.703099 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb44a5-dafd-4721-be37-e6e0d4e9c388 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.714238 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1470/2952] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:48:25.719335 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cf17b-2eaa-43d5-99d4-59bedbf76c61 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.733184 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cf17b-2eaa-43d5-99d4-59bedbf76c61 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.738339 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a055b-0652-442a-bbec-6ae716fdd509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.739299 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a055b-0652-442a-bbec-6ae716fdd509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.740923 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a055b-0652-442a-bbec-6ae716fdd509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.741201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a055b-0652-442a-bbec-6ae716fdd509 admin admin] PATH_INFO: `/v3/projects/a7193800cfa54655b6793f4325f4a9ba/users/4d6a6184724249c092aa3375dcb3121d/roles/4ed7510dfda84b919d68cb8b2bab2916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.743258 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a055b-0652-442a-bbec-6ae716fdd509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7193800cfa54655b6793f4325f4a9ba, user_id=4d6a6184724249c092aa3375dcb3121d, role_id=4ed7510dfda84b919d68cb8b2bab2916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:25.745941 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a055b-0652-442a-bbec-6ae716fdd509 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:25.757214 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1483/2953] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:48:25 2022] PUT /identity/v3/projects/a7193800cfa54655b6793f4325f4a9ba/users/4d6a6184724249c092aa3375dcb3121d/roles/4ed7510dfda84b919d68cb8b2bab2916 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:25.769151 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f081bd-3684-4049-9457-29c64fb3629d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.769453 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f081bd-3684-4049-9457-29c64fb3629d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.769869 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f081bd-3684-4049-9457-29c64fb3629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:25.797735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-14f081bd-3684-4049-9457-29c64fb3629d None None] MFA Rules not processed for user `4d6a6184724249c092aa3375dcb3121d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:25.798987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-14f081bd-3684-4049-9457-29c64fb3629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:25.868406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1471/2954] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:25.884924 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a055b-0652-442a-bbec-6ae716fdd509 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:25.886786 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c01a055b-0652-442a-bbec-6ae716fdd509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:25.958468 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a055b-0652-442a-bbec-6ae716fdd509 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:25.964250 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543671ac-a8c9-471e-a27b-3d00ffc33224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:25.965237 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543671ac-a8c9-471e-a27b-3d00ffc33224 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:25.965665 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543671ac-a8c9-471e-a27b-3d00ffc33224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:25.966100 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543671ac-a8c9-471e-a27b-3d00ffc33224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:26.034154 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543671ac-a8c9-471e-a27b-3d00ffc33224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:26.035563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543671ac-a8c9-471e-a27b-3d00ffc33224 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:26.044563 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1484/2955] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:48:28.608682 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f081bd-3684-4049-9457-29c64fb3629d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:28.628306 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:28.680875 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f081bd-3684-4049-9457-29c64fb3629d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:28.686613 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:28.687536 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:28.687825 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:28.688104 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] PATH_INFO: `/v3/users/41594ddc445d4613ac2d50656df6cb30` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:28.689402 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41594ddc445d4613ac2d50656df6cb30)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:28.691406 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:28.742665 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41594ddc445d4613ac2d50656df6cb30'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:28.754323 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41594ddc445d4613ac2d50656df6cb30'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:28.755007 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41594ddc445d4613ac2d50656df6cb30'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:28.764095 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41594ddc445d4613ac2d50656df6cb30'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:28.770930 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41594ddc445d4613ac2d50656df6cb30'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:28.776941 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1472/2956] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:48:28 2022] DELETE /identity/v3/users/41594ddc445d4613ac2d50656df6cb30 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:28.781567 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c4800-cd79-46f5-a153-2a4351cafc69 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:28.782057 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c4800-cd79-46f5-a153-2a4351cafc69 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:28.782201 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c4800-cd79-46f5-a153-2a4351cafc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:28.800638 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5c5c4800-cd79-46f5-a153-2a4351cafc69 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:28.801832 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5c5c4800-cd79-46f5-a153-2a4351cafc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:28.821538 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:28.864565 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1485/2957] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:28.877168 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:28.878735 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:28.937421 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8411de-fc55-4a91-9ca3-5cb1cf27ebc9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:28.941160 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c193939-2e89-43e9-b4ef-905923905b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:28.941811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c193939-2e89-43e9-b4ef-905923905b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:28.942119 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c193939-2e89-43e9-b4ef-905923905b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:28.942392 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c193939-2e89-43e9-b4ef-905923905b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:28.951661 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c193939-2e89-43e9-b4ef-905923905b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:28.953098 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c193939-2e89-43e9-b4ef-905923905b74 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:28.962514 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1473/2958] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:48:29.250775 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c4800-cd79-46f5-a153-2a4351cafc69 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:29.252281 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5c5c4800-cd79-46f5-a153-2a4351cafc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:29.264913 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c4800-cd79-46f5-a153-2a4351cafc69 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:29.269922 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:29.270821 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:29.271106 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:29.271416 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] PATH_INFO: `/v3/projects/f30d06e83d6d444db2283b68f5ee52c9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:29.272613 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30d06e83d6d444db2283b68f5ee52c9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:29.274845 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:29.324430 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30d06e83d6d444db2283b68f5ee52c9', 'request_id': 'req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.330630 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30d06e83d6d444db2283b68f5ee52c9', 'request_id': 'req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.339976 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30d06e83d6d444db2283b68f5ee52c9', 'request_id': 'req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.355001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] The token cache is being invalidate because project f30d06e83d6d444db2283b68f5ee52c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:48:29.355284 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.356004 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.357691 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1486/2959] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:48:29 2022] DELETE /identity/v3/projects/f30d06e83d6d444db2283b68f5ee52c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:29.362348 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c193939-2e89-43e9-b4ef-905923905b74 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:29.377887 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c193939-2e89-43e9-b4ef-905923905b74 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:29.416646 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:29.442525 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:29.443464 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:29.443753 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:29.444035 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] PATH_INFO: `/v3/users/4d6a6184724249c092aa3375dcb3121d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:29.445362 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6a6184724249c092aa3375dcb3121d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:29.447356 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:29.495852 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6a6184724249c092aa3375dcb3121d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.507708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6a6184724249c092aa3375dcb3121d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.508374 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6a6184724249c092aa3375dcb3121d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.517127 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6a6184724249c092aa3375dcb3121d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.524258 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-771cd240-140c-43b1-9373-0e5ecd05e893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6a6184724249c092aa3375dcb3121d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.530280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1474/2960] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:48:29 2022] DELETE /identity/v3/users/4d6a6184724249c092aa3375dcb3121d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:29.828287 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:29.829802 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:29.843174 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fe9d0-48b8-4152-ad0d-6d300a2356cf admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:29.903346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:29.904557 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:29.904912 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:29.905278 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] PATH_INFO: `/v3/projects/a7193800cfa54655b6793f4325f4a9ba` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:29.907196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7193800cfa54655b6793f4325f4a9ba)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:29.910265 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:29.960283 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7193800cfa54655b6793f4325f4a9ba', 'request_id': 'req-661ebbc0-4abc-46fb-a599-f1b1c0e86307'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.961422 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:29.968320 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7193800cfa54655b6793f4325f4a9ba', 'request_id': 'req-661ebbc0-4abc-46fb-a599-f1b1c0e86307'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.977196 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7193800cfa54655b6793f4325f4a9ba', 'request_id': 'req-661ebbc0-4abc-46fb-a599-f1b1c0e86307'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.988055 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] The token cache is being invalidate because project a7193800cfa54655b6793f4325f4a9ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:48:29.988344 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.988961 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-661ebbc0-4abc-46fb-a599-f1b1c0e86307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:29.990524 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1487/2961] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:48:29 2022] DELETE /identity/v3/projects/a7193800cfa54655b6793f4325f4a9ba => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:29.995841 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52b042-ab34-4b55-9e71-73610a597939 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:29.996303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52b042-ab34-4b55-9e71-73610a597939 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:29.996410 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52b042-ab34-4b55-9e71-73610a597939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.016424 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7b52b042-ab34-4b55-9e71-73610a597939 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:30.017904 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7b52b042-ab34-4b55-9e71-73610a597939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:30.081943 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1475/2962] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:30.090001 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af088fa8-9b17-4c80-b6df-7e04f3dd5b76 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:30.090326 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af088fa8-9b17-4c80-b6df-7e04f3dd5b76 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:30.090607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af088fa8-9b17-4c80-b6df-7e04f3dd5b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.111623 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-af088fa8-9b17-4c80-b6df-7e04f3dd5b76 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:30.112852 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-af088fa8-9b17-4c80-b6df-7e04f3dd5b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:30.122388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1488/2963] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:30.126811 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52b042-ab34-4b55-9e71-73610a597939 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:30.137054 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52b042-ab34-4b55-9e71-73610a597939 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:30.142970 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9ebd6-7239-46d8-9f8f-3b1b9f6ebf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:30.143671 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9ebd6-7239-46d8-9f8f-3b1b9f6ebf85 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:30.143948 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9ebd6-7239-46d8-9f8f-3b1b9f6ebf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:30.144224 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9ebd6-7239-46d8-9f8f-3b1b9f6ebf85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.144956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9ebd6-7239-46d8-9f8f-3b1b9f6ebf85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 13:48:30.145268 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9ebd6-7239-46d8-9f8f-3b1b9f6ebf85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:30.146956 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9ebd6-7239-46d8-9f8f-3b1b9f6ebf85 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:30.159352 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1476/2964] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 17 13:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 13:48:30.163898 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af088fa8-9b17-4c80-b6df-7e04f3dd5b76 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:30.173682 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af088fa8-9b17-4c80-b6df-7e04f3dd5b76 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:30.180037 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b7cd6-916a-4cec-9b70-0c88a75c1243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:30.180688 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b7cd6-916a-4cec-9b70-0c88a75c1243 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:30.181008 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b7cd6-916a-4cec-9b70-0c88a75c1243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:30.181272 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b7cd6-916a-4cec-9b70-0c88a75c1243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.181947 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b7cd6-916a-4cec-9b70-0c88a75c1243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:30.183939 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b7cd6-916a-4cec-9b70-0c88a75c1243 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:30.215476 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1489/2965] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 17 13:48:30 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 13:48:30.222326 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9ebd6-7239-46d8-9f8f-3b1b9f6ebf85 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:30.234516 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9ebd6-7239-46d8-9f8f-3b1b9f6ebf85 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:30.278405 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:30.295656 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b91427-754c-4b17-be85-47c4b6c00aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:30.296361 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b91427-754c-4b17-be85-47c4b6c00aec admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:30.296649 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b91427-754c-4b17-be85-47c4b6c00aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:30.296925 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b91427-754c-4b17-be85-47c4b6c00aec admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.297627 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b91427-754c-4b17-be85-47c4b6c00aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:30.299632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b91427-754c-4b17-be85-47c4b6c00aec admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:30.321822 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1477/2966] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 17 13:48:30 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 13:48:30.325955 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b7cd6-916a-4cec-9b70-0c88a75c1243 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:30.337140 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b7cd6-916a-4cec-9b70-0c88a75c1243 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:30.342427 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05946c7-8cfc-42e0-81ad-53ba44b08ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:30.343120 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05946c7-8cfc-42e0-81ad-53ba44b08ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:30.343401 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05946c7-8cfc-42e0-81ad-53ba44b08ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:30.343674 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05946c7-8cfc-42e0-81ad-53ba44b08ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.344398 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05946c7-8cfc-42e0-81ad-53ba44b08ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:30.346046 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05946c7-8cfc-42e0-81ad-53ba44b08ffc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:30.358357 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1490/2967] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:48:30.362659 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b91427-754c-4b17-be85-47c4b6c00aec admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:30.374987 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b91427-754c-4b17-be85-47c4b6c00aec admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:30.380407 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06b40f-c71c-42ea-94f2-4ceb5151f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:30.381269 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b40f-c71c-42ea-94f2-4ceb5151f9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:30.381632 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b40f-c71c-42ea-94f2-4ceb5151f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:30.381892 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b40f-c71c-42ea-94f2-4ceb5151f9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.383132 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06b40f-c71c-42ea-94f2-4ceb5151f9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:30.384714 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06b40f-c71c-42ea-94f2-4ceb5151f9bb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:30.395339 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1478/2968] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 17 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 13:48:30.399677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05946c7-8cfc-42e0-81ad-53ba44b08ffc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:30.410203 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05946c7-8cfc-42e0-81ad-53ba44b08ffc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:30.417181 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3f268-2271-4f09-8e8e-77414235d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:30.418215 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3f268-2271-4f09-8e8e-77414235d822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:30.418505 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3f268-2271-4f09-8e8e-77414235d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:30.418784 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3f268-2271-4f09-8e8e-77414235d822 admin admin] PATH_INFO: `/v3/projects/774a761d21204be5880b557f0470386a/users/9cfe92d1a3ca4d61b86073c925544fe6/roles/3d852826ac0a4f09b618a220333f2897` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.435846 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3f268-2271-4f09-8e8e-77414235d822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774a761d21204be5880b557f0470386a, user_id=9cfe92d1a3ca4d61b86073c925544fe6, role_id=3d852826ac0a4f09b618a220333f2897)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:30.438607 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3f268-2271-4f09-8e8e-77414235d822 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:30.453549 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1491/2969] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 17 13:48:30 2022] PUT /identity/v3/projects/774a761d21204be5880b557f0470386a/users/9cfe92d1a3ca4d61b86073c925544fe6/roles/3d852826ac0a4f09b618a220333f2897 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:30.464814 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aced735-301d-415d-91e0-6fc7120f0675 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:30.465110 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aced735-301d-415d-91e0-6fc7120f0675 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:30.465381 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aced735-301d-415d-91e0-6fc7120f0675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.493593 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1aced735-301d-415d-91e0-6fc7120f0675 None None] MFA Rules not processed for user `9cfe92d1a3ca4d61b86073c925544fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:30.494830 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1aced735-301d-415d-91e0-6fc7120f0675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:30.564336 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1479/2970] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:30.575244 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3f268-2271-4f09-8e8e-77414235d822 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:30.577090 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3fb3f268-2271-4f09-8e8e-77414235d822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:30.636724 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3f268-2271-4f09-8e8e-77414235d822 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:30.641117 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b4828-0bb9-4e7d-80e8-a5fa3672b0de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68fc7c689f3645149d927663730bab5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:30.641776 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b4828-0bb9-4e7d-80e8-a5fa3672b0de service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:30.642064 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b4828-0bb9-4e7d-80e8-a5fa3672b0de service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:30.642378 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b4828-0bb9-4e7d-80e8-a5fa3672b0de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:30.652264 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b4828-0bb9-4e7d-80e8-a5fa3672b0de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:30.653755 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b4828-0bb9-4e7d-80e8-a5fa3672b0de service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:30.663622 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1492/2971] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:48:40.561434 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:40.658848 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=59,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:48:53.262532 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aced735-301d-415d-91e0-6fc7120f0675 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:53.329633 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aced735-301d-415d-91e0-6fc7120f0675 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:53.335022 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:53.335928 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:53.336206 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:53.336481 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] PATH_INFO: `/v3/users/9cfe92d1a3ca4d61b86073c925544fe6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:53.337801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cfe92d1a3ca4d61b86073c925544fe6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:53.339809 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:53.389708 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cfe92d1a3ca4d61b86073c925544fe6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.401576 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cfe92d1a3ca4d61b86073c925544fe6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.402280 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cfe92d1a3ca4d61b86073c925544fe6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.410775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cfe92d1a3ca4d61b86073c925544fe6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.417927 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cfe92d1a3ca4d61b86073c925544fe6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.423909 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1480/2972] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 17 13:48:53 2022] DELETE /identity/v3/users/9cfe92d1a3ca4d61b86073c925544fe6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:48:53.428384 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a9c55-9f44-46b4-baad-e4a46d7f81e9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:53.428919 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a9c55-9f44-46b4-baad-e4a46d7f81e9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:53.429074 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a9c55-9f44-46b4-baad-e4a46d7f81e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:53.448346 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-201a9c55-9f44-46b4-baad-e4a46d7f81e9 None None] MFA Rules not processed for user `037e9f95a2ad44f08247184b10274c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:48:53.449559 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-201a9c55-9f44-46b4-baad-e4a46d7f81e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:53.510778 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1493/2973] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 17 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:48:53.520626 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:53.522197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:53.580307 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e37fcd-9b31-448e-872f-44c5dda34b46 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:53.584768 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b987815-9cc8-4353-bf73-da8003e48dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '688ecef411094633927ffd663ffa1818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:53.585487 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b987815-9cc8-4353-bf73-da8003e48dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:53.585758 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b987815-9cc8-4353-bf73-da8003e48dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:53.586037 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b987815-9cc8-4353-bf73-da8003e48dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:53.595854 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b987815-9cc8-4353-bf73-da8003e48dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:53.597303 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b987815-9cc8-4353-bf73-da8003e48dc5 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:53.607284 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1481/2974] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 13:48:53.885892 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a9c55-9f44-46b4-baad-e4a46d7f81e9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:48:53.887404 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-201a9c55-9f44-46b4-baad-e4a46d7f81e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:48:53.900970 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a9c55-9f44-46b4-baad-e4a46d7f81e9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:48:53.905816 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '037e9f95a2ad44f08247184b10274c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91e888714806438f834a0309a74fcb9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:48:53.906768 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:48:53.907052 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:48:53.907328 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] PATH_INFO: `/v3/projects/774a761d21204be5880b557f0470386a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:48:53.908657 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] RBAC: Authorizing `identity:delete_project(project_id=774a761d21204be5880b557f0470386a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:48:53.910645 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:48:53.957572 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774a761d21204be5880b557f0470386a', 'request_id': 'req-938593c7-1fa9-481e-8a46-287d531ac99b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.965411 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774a761d21204be5880b557f0470386a', 'request_id': 'req-938593c7-1fa9-481e-8a46-287d531ac99b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.975289 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774a761d21204be5880b557f0470386a', 'request_id': 'req-938593c7-1fa9-481e-8a46-287d531ac99b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.987388 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] The token cache is being invalidate because project 774a761d21204be5880b557f0470386a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 13:48:53.987677 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.988323 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-938593c7-1fa9-481e-8a46-287d531ac99b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 13:48:53.989901 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1494/2975] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 17 13:48:53 2022] DELETE /identity/v3/projects/774a761d21204be5880b557f0470386a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 13:49:03.603375 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:49:03.984617 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:50:58.561839 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b987815-9cc8-4353-bf73-da8003e48dc5 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:50:58.563463 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9b987815-9cc8-4353-bf73-da8003e48dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:50:58.712219 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b987815-9cc8-4353-bf73-da8003e48dc5 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:50:58.776346 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:50:58.777008 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:50:58.777297 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:50:58.777580 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:50:58.779597 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:50:58.791164 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:50:58.792775 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:50:58.802899 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1482/2976] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:50:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:51:08.798801 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:53:00.574885 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6739c8-4513-4f20-a348-8805fb97cb25 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:53:00.575480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6739c8-4513-4f20-a348-8805fb97cb25 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:53:00.575480 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6739c8-4513-4f20-a348-8805fb97cb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:53:00.616292 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ba6739c8-4513-4f20-a348-8805fb97cb25 None None] MFA Rules not processed for user `5d9781351e60447dbcbe4ee51322a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 13:53:00.617531 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ba6739c8-4513-4f20-a348-8805fb97cb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:53:00.628419 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1495/2977] 10.222.0.75 () {58 vars in 1015 bytes} [Fri Jun 17 13:53:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 13:53:00.643207 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 13:53:00.644748 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 13:53:00.658779 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413ba2f-fda4-482c-badc-667783e5c739 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 13:53:00.665225 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e56c5b-5c1f-4548-9280-2291193ef9b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9781351e60447dbcbe4ee51322a3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82c9d894195d4300849f8401a6af0d82', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 13:53:00.665876 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e56c5b-5c1f-4548-9280-2291193ef9b7 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 13:53:00.666197 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e56c5b-5c1f-4548-9280-2291193ef9b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 13:53:00.666470 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e56c5b-5c1f-4548-9280-2291193ef9b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 13:53:00.675399 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e56c5b-5c1f-4548-9280-2291193ef9b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 13:53:00.677021 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e56c5b-5c1f-4548-9280-2291193ef9b7 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 13:53:00.686994 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1483/2978] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 17 13:53:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 13:53:10.613944 dv-cinder-837543-5-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=9 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 13:53:10.683065 dv-cinder-837543-5-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}